Apr 29 09:00:54 devstack cinder-volume[75168]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 09:00:54 devstack cinder-volume[75168]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 09:00:54 devstack cinder-volume[75168]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 09:00:54 devstack cinder-volume[75168]: INFO dbcounter [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Registered counter for database cinder
Apr 29 09:00:54 devstack cinder-volume[75168]: DEBUG oslo_db.sqlalchemy.engines [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG dbcounter [-] [75168] Writer thread running {{(pid=75168) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO cinder.rpc [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO cinder.rpc [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_db.sqlalchemy.engines [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO cinder.volume.manager [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Determined volume DB was empty at startup.
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG cinder.volume.manager [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75168) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO cinder.volume.manager [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 09:00:55 devstack cinder-volume[75168]: WARNING stevedore.named [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 09:00:55 devstack cinder-volume[75168]: WARNING castellan.key_manager [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 09:00:55 devstack cinder-volume[75168]: WARNING cinder.keymgr.conf_key_mgr [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG cinder.volume.drivers.lvm [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75168) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_concurrency.processutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75168) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_concurrency.processutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] CMD "cinder-rtstool verify" returned: 0 in 0.398s {{(pid=75168) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_db.sqlalchemy.engines [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO cinder.rpc [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO cinder.rpc [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 29 09:00:55 devstack cinder-volume[75168]: WARNING stevedore.named [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 09:00:55 devstack cinder-volume[75168]: WARNING castellan.key_manager [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO cinder.volume.manager [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_db.sqlalchemy.engines [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75168) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:00:55 devstack cinder-volume[75168]: INFO oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Starting 1 workers
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Started child 75345 {{(pid=75168) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Full set of CONF: {{(pid=75168) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] ******************************************************************************** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Configuration options gathered from: {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] ================================================================================ {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] allow_availability_zone_fallback = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] allow_compression_on_image_upload = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:55 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] allowed_direct_url_schemes     = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:55 devstack cinder-volume[75345]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] api_rate_limit                 = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] auth_strategy                  = keystone {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] az_cache_duration              = 3600 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_availability_zone      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_host                   = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_name                   = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_stats_polling_interval = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backup_api_class               = cinder.backup.api.API {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backup_name_template           = backup-%s {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backup_use_same_host           = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backup_use_temp_snapshot       = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] chap_password                  = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] chap_username                  =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_internal_tenant_project_id = 7657ba1a65734e77a25bcbc0be78c59f {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_internal_tenant_user_id = 38a2c9ed510a41b9b508c5e9b2fceea9 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cloned_volume_same_az          = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cluster                        = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] compression_format             = gzip {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] config_dir                     = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] config_source                  = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] control_exchange               = openstack {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] debug                          = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] default_availability_zone      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] default_group_type             = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] default_volume_type            = lvmdriver-1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] disk_geometry                  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] driver_client_cert             = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] driver_client_cert_key         = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] driver_data_namespace          = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] driver_ssl_cert_path           = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] driver_ssl_cert_verify         = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] driver_use_ssl                 = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] enable_force_upload            = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] enable_new_services            = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] enable_unsupported_driver      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] enforce_multipath_for_image_xfer = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] filter_function                = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_api_insecure            = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_api_ssl_compression     = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_ca_certificates_file    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_certfile                = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_keyfile                 = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_num_retries             = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance_request_timeout         = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] goodness_function              = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] graceful_shutdown_timeout      = 5 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] group_api_class                = cinder.group.api.API {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] host                           = devstack {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_compress_on_upload       = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_conversion_address_space_limit = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_conversion_cpu_limit     = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_conversion_disable       = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_upload_use_cinder_backend = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_upload_use_internal_tenant = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_volume_cache_enabled     = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_volume_cache_max_count   = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] image_volume_cache_max_size_gb = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] init_host_max_objects_retrieval = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] iscsi_target_flags             =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] iscsi_write_cache              = on {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] iser_helper                    = tgtadm {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] iser_ip_address                = 192.168.122.169 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack sudo[75399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] iser_port                      = 3260 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack sudo[75399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:00:56 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_color                      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_config_append              = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_dir                        = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_file                       = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_options                    = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_rotate_interval            = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_rotate_interval_type       = days {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] log_rotation_type              = none {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] max_age                        = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] max_logfile_count              = 30 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] max_logfile_size_mb            = 200 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] max_over_subscription_ratio    = 20.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] message_reap_interval          = 86400 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] message_ttl                    = 2592000 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] migration_create_volume_timeout_secs = 300 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] monkey_patch                   = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] monkey_patch_modules           = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] my_ip                          = 192.168.122.169 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] no_snapshot_gb_quota           = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] num_iser_scan_tries            = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] num_shell_tries                = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] num_volume_device_scan_tries   = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] nvmeof_conn_info_version       = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] nvmet_ns_id                    = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] nvmet_port_id                  = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] osapi_max_limit                = 1000 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] osapi_volume_ext_list          = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] osapi_volume_listen_port       = 8776 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] osapi_volume_use_ssl           = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] osapi_volume_workers           = 2 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] per_volume_size_limit          = -1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] periodic_fuzzy_delay           = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] periodic_interval              = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] public_endpoint                = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] publish_errors                 = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] quota_backup_gigabytes         = 1000 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] quota_backups                  = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] quota_gigabytes                = 1000 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] quota_groups                   = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] quota_snapshots                = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] quota_volumes                  = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] rate_limit_burst               = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] rate_limit_except_level        = CRITICAL {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] rate_limit_interval            = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] reinit_driver_count            = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] replication_device             = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] report_discard_supported       = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] report_interval                = 120 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] reservation_clean_interval     = 86400 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] reservation_expire             = 86400 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] reserved_image_namespaces      = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] reserved_percentage            = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] rpc_response_timeout           = 120 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] run_external_periodic_tasks    = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] scst_target_driver             = iscsi {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] scst_target_iqn_name           = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_down_time              = 720 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] shell_completion               = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] snapshot_name_template         = snapshot-%s {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] snapshot_same_host             = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] split_loggers                  = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] state_path                     = /opt/stack/data/cinder {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] storage_availability_zone      = nova {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] storage_protocol               = iSCSI {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] syslog_log_facility            = LOG_USER {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] target_helper                  = lioadm {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] target_ip_address              = 192.168.122.169 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] target_port                    = 3260 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] target_protocol                = iscsi {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] target_secondary_ip_addresses  = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] trace_flags                    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] transport_url                  = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] until_refresh                  = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] use_chap_auth                  = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] use_default_quota_class        = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] use_journal                    = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] use_json                       = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] use_multipath_for_image_xfer   = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] use_stderr                     = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] use_syslog                     = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] verify_glance_signatures       = enabled {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_api_class               = cinder.volume.api.API {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_backend_name            = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_clear                   = zero {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_clear_ionice            = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_clear_size              = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_copy_bps_limit          = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_dd_blocksize            = 1M {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_name_template           = volume-%s {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_service_inithost_offload = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volume_usage_audit_period      = month {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] zoning_mode                    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_concurrency.disable_process_locking = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.admin_password = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.admin_token = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.admin_user  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_protocol = https {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_section = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_type   = password {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_uri    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.auth_version = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.cache       = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.certfile    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.identity_uri = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.include_service_catalog = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.insecure    = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.interface   = public {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.keyfile     = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_password =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcache_username =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.region_name = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.service_type = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.backend                  = dogpile.cache.null {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.backend_argument         = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.backend_expiration_time  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.config_prefix            = cache.oslo {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.debug_cache_backend      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.enable_retry_client      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.enable_socket_keepalive  = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.enabled                  = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.enforce_fips_mode        = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.expiration_time          = 600 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.hashclient_retry_attempts = 2 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.memcache_dead_retry      = 300 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.memcache_sasl_enabled    = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.password                 = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.proxies                  = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.redis_db                 = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.redis_server             = localhost:6379 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.retry_attempts           = 2 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.retry_delay              = 0.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.socket_keepalive_count   = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.socket_keepalive_idle    = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.socket_keepalive_interval = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.socket_timeout           = 1.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.tls_allowed_ciphers      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.tls_cafile               = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.tls_certfile             = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.tls_enabled              = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.tls_keyfile              = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cache.username                 = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] coordination.backend_url       = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.asyncio_connection    = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.asyncio_slave_connection = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.backend               = sqlalchemy {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.connection            = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.connection_debug      = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.connection_parameters =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.connection_recycle_time = 3600 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.connection_trace      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.db_inc_retry_interval = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.db_max_retries        = 20 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.db_max_retry_interval = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.db_retry_interval     = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.max_overflow          = 50 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.max_pool_size         = 5 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.max_retries           = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.mysql_wsrep_sync_wait = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.pool_timeout          = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.retry_interval        = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.slave_connection      = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.sqlite_synchronous    = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.synchronous_reader    = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] database.use_db_reconnect      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.connection_string     = messaging:// {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.enabled               = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.es_doc_type           = notification {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.es_scroll_size        = 10000 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.es_scroll_time        = 2m {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.filter_error_trace    = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.hmac_keys             = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.sentinel_service_name = mymaster {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.socket_timeout        = 0.1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.trace_requests        = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler.trace_sqlalchemy      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler_jaeger.process_tags   = {} {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler_jaeger.service_name_prefix = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] profiler_otlp.service_name_prefix = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.enforce_new_defaults = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: WARNING oslo_config.cfg [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.enforce_scope      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.policy_default_rule = default {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] privsep_osbrick.group          = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] privsep_osbrick.helper_command = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] privsep_osbrick.user           = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_sys_admin.group         = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_sys_admin.helper_command = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] cinder_sys_admin.user          = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.auth_section      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.auth_type         = password {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.cafile            = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.certfile          = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.collect_timing    = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.insecure          = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.keyfile           = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.send_service_user_token = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.split_loggers     = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] service_user.timeout           = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.auth_section            = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.auth_type               = password {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.certfile                = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.collect_timing          = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.insecure                = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.keyfile                 = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.region_name             = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.split_loggers           = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] glance.timeout                 = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.backend_availability_zone = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.chap_password = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.chap_username =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.disk_geometry = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.driver_client_cert = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.driver_client_cert_key = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.driver_data_namespace = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.driver_use_ssl = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.extra_capabilities = {} {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.filter_function = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.goodness_function = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.iscsi_target_flags =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.iscsi_write_cache = on {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.iser_port     = 3260 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.lvm_share_target = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.lvm_type      = auto {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.num_shell_tries = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.replication_device = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.report_discard_supported = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.reserved_percentage = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.target_helper = tgtadm {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.target_port   = 3260 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.target_protocol = iscsi {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.trace_flags   = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.unique_fqdn_network = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.use_chap_auth = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_backend_name = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_clear  = zero {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_clear_ionice = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_clear_size = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_reports.file_event_handler = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_reports.log_dir           = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.backend_host       = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.chap_password      = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.chap_username      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.disk_geometry      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.driver_client_cert = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.extra_capabilities = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.filter_function    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.goodness_function  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.iser_helper        = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.iser_port          = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.lvm_type           = auto {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.replication_device = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.report_discard_supported = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.reserved_percentage = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.scst_target_driver = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.storage_protocol   = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.target_ip_address  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.target_port        = 3260 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.trace_flags        = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_clear       = zero {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] lvmdriver-1.volumes_dir        = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_notifications.driver = [] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_notifications.retry = -1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] key_manager.fixed_key          = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.barbican_api_version  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.barbican_endpoint     = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.barbican_endpoint_type = public {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.barbican_region_name  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.cafile                = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.certfile              = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.collect_timing        = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.insecure              = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.keyfile               = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.number_of_retries     = 60 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.retry_delay           = 1 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.send_service_user_token = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.split_loggers         = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.timeout               = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.verify_ssl            = True {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican.verify_ssl_path       = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.auth_section = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.auth_type = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.cafile   = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.certfile = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.collect_timing = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.insecure = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.keyfile  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.split_loggers = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] barbican_service_user.timeout  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.approle_role_id          = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.approle_secret_id        = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.kv_mountpoint            = secret {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.kv_path                  = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.kv_version               = 2 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.namespace                = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.root_token_id            = **** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.ssl_ca_crt_file          = None {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.timeout                  = 60.0 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.use_ssl                  = False {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:00:56 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] ******************************************************************************** {{(pid=75168) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 09:00:56 devstack sudo[75399]: pam_unix(sudo:session): session closed for user root
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.827s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:56 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:57 devstack sudo[75600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:00:57 devstack sudo[75600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:00:57 devstack sudo[75600]: pam_unix(sudo:session): session closed for user root
Apr 29 09:00:57 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.646s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:57 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:00:57 devstack cinder-volume[75345]: INFO cinder.brick.local_dev.lvm [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 29 09:00:57 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:57 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:57 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:57 devstack sudo[75823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:00:57 devstack sudo[75823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:00:58 devstack sudo[75823]: pam_unix(sudo:session): session closed for user root
Apr 29 09:00:58 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:58 devstack cinder-volume[75345]: DEBUG cinder.brick.local_dev.lvm [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75345) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 29 09:00:58 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:58 devstack sudo[75913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:00:58 devstack sudo[75913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:00:59 devstack sudo[75913]: pam_unix(sudo:session): session closed for user root
Apr 29 09:00:59 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.049s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:59 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:59 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:00:59 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:00:59 devstack sudo[76113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:00:59 devstack sudo[76113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:00 devstack sudo[76113]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.726s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:00 devstack sudo[76123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 29 09:01:00 devstack sudo[76123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:00 devstack sudo[76123]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.742s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:00 devstack sudo[76127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:01:00 devstack sudo[76127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:01 devstack sudo[76127]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:01 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:01 devstack sudo[76132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:01:01 devstack sudo[76132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:02 devstack sudo[76132]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:02 devstack sudo[76135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:01:02 devstack sudo[76135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:02 devstack sudo[76135]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:02 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:02 devstack sudo[76140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:01:02 devstack sudo[76140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:03 devstack sudo[76140]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:03 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:03 devstack sudo[76148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:01:03 devstack sudo[76148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:04 devstack sudo[76148]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.814s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:04 devstack cinder-volume[75345]: INFO cinder.volume.drivers.lvm [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 29 09:01:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:04 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:04 devstack sudo[76155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:01:04 devstack sudo[76155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:05 devstack sudo[76155]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.985s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:05 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 09:01:05 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:05 devstack sudo[76272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:01:05 devstack sudo[76272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:05 devstack cinder-volume[75168]: DEBUG dbcounter [-] [75168] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75168) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:01:06 devstack sudo[76272]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:06 devstack sudo[76414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:01:06 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:06 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:06 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:06 devstack sudo[76420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:01:06 devstack sudo[76420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:07 devstack sudo[76420]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.608s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:07 devstack sudo[76423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:01:07 devstack sudo[76423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:07 devstack sudo[76423]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.571s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:07 devstack cinder-volume[75345]: INFO cinder.volume.driver [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG cinder.volume.driver [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75345) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG oslo_db.sqlalchemy.engines [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writer thread running {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG cinder.db.sqlalchemy.api [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Building query based on filter {{(pid=75345) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG cinder.image.image_utils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75345) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 09:01:07 devstack cinder-volume[75345]: INFO cinder.keymgr.migration [None req-d71f24ac-c947-4fb3-959a-e34b7cd35d08 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 09:01:07 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:07 devstack sudo[76427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:01:07 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:08 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:08 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:08 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:08 devstack sudo[76430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:01:08 devstack sudo[76430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:09 devstack sudo[76430]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:09 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:09 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:09 devstack sudo[76434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:01:09 devstack sudo[76434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:09 devstack sudo[76434]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:09 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:09 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:09 devstack sudo[76440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:01:09 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:10 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:10 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:10 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:01:10 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Driver initialization completed successfully.
Apr 29 09:01:10 devstack cinder-volume[75345]: INFO cinder.manager [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Initiating service 2 cleanup
Apr 29 09:01:10 devstack cinder-volume[75345]: INFO cinder.manager [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Service 2 cleanup completed.
Apr 29 09:01:10 devstack cinder-volume[75345]: DEBUG cinder.service [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Creating RPC server for service cinder-volume {{(pid=75345) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 09:01:10 devstack cinder-volume[75345]: DEBUG cinder.service [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75345) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 09:01:10 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 29 09:01:10 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 09:01:10 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:10 devstack sudo[76478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:01:10 devstack sudo[76478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:11 devstack sudo[76478]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:11 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:11 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:11 devstack sudo[76484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:01:11 devstack sudo[76484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:11 devstack sudo[76484]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:11 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:11 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:11 devstack sudo[76487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:01:11 devstack sudo[76487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:12 devstack sudo[76487]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:12 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:12 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:01:12 devstack sudo[76544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:01:12 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:01:13 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root
Apr 29 09:01:13 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:01:13 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-7a9c6062-2e73-4bf2-ad12-6a13a6e5f910 None None] Driver post RPC initialization completed successfully.
Apr 29 09:01:23 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:01:23 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:02:31 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:02:31 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 09:02:31 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:02:31 devstack sudo[81203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:02:31 devstack sudo[81203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:02:31 devstack sudo[81203]: pam_unix(sudo:session): session closed for user root
Apr 29 09:02:31 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:02:31 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:02:31 devstack sudo[81207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:02:31 devstack sudo[81207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:02:32 devstack sudo[81207]: pam_unix(sudo:session): session closed for user root
Apr 29 09:02:32 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:02:32 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:02:32 devstack sudo[81210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:02:32 devstack sudo[81210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:02:33 devstack sudo[81210]: pam_unix(sudo:session): session closed for user root
Apr 29 09:02:33 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:02:33 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:02:33 devstack sudo[81229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:02:33 devstack sudo[81229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:02:33 devstack sudo[81229]: pam_unix(sudo:session): session closed for user root
Apr 29 09:02:33 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:02:33 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:03:23 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:03:23 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:UPDATE=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:03:31 devstack cinder-volume[75345]: DEBUG oslo_service.periodic_task [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75345) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:03:31 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Updating volume stats {{(pid=75345) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 29 09:03:31 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:03:31 devstack sudo[81636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 29 09:03:31 devstack sudo[81636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:03:31 devstack sudo[81636]: pam_unix(sudo:session): session closed for user root
Apr 29 09:03:31 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:03:31 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:03:31 devstack sudo[81639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:03:31 devstack sudo[81639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:03:32 devstack sudo[81639]: pam_unix(sudo:session): session closed for user root
Apr 29 09:03:32 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:03:32 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:03:32 devstack sudo[81642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 29 09:03:32 devstack sudo[81642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:03:33 devstack sudo[81642]: pam_unix(sudo:session): session closed for user root
Apr 29 09:03:33 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:03:33 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:03:33 devstack sudo[81647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 29 09:03:33 devstack sudo[81647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:03:33 devstack sudo[81647]: pam_unix(sudo:session): session closed for user root
Apr 29 09:03:33 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:03:33 devstack cinder-volume[75345]: DEBUG cinder.manager [None req-2be17aea-0874-4a12-aa2e-33efbeb8688f None None] Notifying Schedulers of capabilities ... {{(pid=75345) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:03:59 devstack cinder-volume[75168]: INFO oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Caught SIGTERM, stopping children
Apr 29 09:03:59 devstack cinder-volume[75168]: DEBUG oslo_concurrency.lockutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Acquiring lock "singleton_lock" {{(pid=75168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 09:03:59 devstack cinder-volume[75168]: DEBUG oslo_concurrency.lockutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Acquired lock "singleton_lock" {{(pid=75168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 09:03:59 devstack cinder-volume[75168]: DEBUG oslo_concurrency.lockutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Releasing lock "singleton_lock" {{(pid=75168) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 09:03:59 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Stop services. {{(pid=75168) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 09:03:59 devstack cinder-volume[75168]: DEBUG oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Killing children. {{(pid=75168) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 09:03:59 devstack cinder-volume[75168]: INFO oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Waiting on 1 children to exit
Apr 29 09:04:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Acquiring lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 09:04:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Acquired lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 09:04:00 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Releasing lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 09:04:00 devstack cinder-volume[75345]: WARNING amqp [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 09:04:00 devstack cinder-volume[75345]: WARNING amqp [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 09:04:00 devstack cinder-volume[75168]: INFO oslo_service.backend._eventlet.service [None req-9494b08e-b301-4715-9fcf-3eee5bdf8a82 None None] Child 75345 exited with status 0
Apr 29 09:04:03 devstack cinder-volume[82969]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 09:04:03 devstack cinder-volume[82969]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 09:04:03 devstack cinder-volume[82969]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 09:04:03 devstack cinder-volume[82969]: INFO dbcounter [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Registered counter for database cinder
Apr 29 09:04:03 devstack cinder-volume[82969]: DEBUG oslo_db.sqlalchemy.engines [None req-04accf79-bc29-4154-8015-3556f81c547b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG dbcounter [-] [82969] Writer thread running {{(pid=82969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 09:04:04 devstack cinder-volume[82969]: INFO cinder.rpc [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 09:04:04 devstack cinder-volume[82969]: INFO cinder.rpc [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_db.sqlalchemy.engines [None req-04accf79-bc29-4154-8015-3556f81c547b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:04 devstack cinder-volume[82969]: INFO cinder.volume.manager [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Determined volume DB was empty at startup.
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG cinder.volume.manager [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82969) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 09:04:04 devstack cinder-volume[82969]: INFO cinder.volume.manager [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 29 09:04:04 devstack cinder-volume[82969]: WARNING stevedore.named [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 09:04:04 devstack cinder-volume[82969]: WARNING castellan.key_manager [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 09:04:04 devstack cinder-volume[82969]: WARNING cinder.keymgr.conf_key_mgr [None req-04accf79-bc29-4154-8015-3556f81c547b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 09:04:04 devstack cinder-volume[82969]: INFO cinder.volume.manager [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_db.sqlalchemy.engines [None req-04accf79-bc29-4154-8015-3556f81c547b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:04 devstack cinder-volume[82969]: INFO oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Starting 1 workers
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Started child 83223 {{(pid=82969) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Full set of CONF: {{(pid=82969) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] ******************************************************************************** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Configuration options gathered from: {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] ================================================================================ {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] allow_availability_zone_fallback = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] allow_compression_on_image_upload = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] allowed_direct_url_schemes     = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] api_rate_limit                 = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] auth_strategy                  = keystone {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[83223]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_availability_zone      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_host                   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_name                   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_stats_polling_interval = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backup_api_class               = cinder.backup.api.API {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backup_name_template           = backup-%s {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backup_use_same_host           = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backup_use_temp_snapshot       = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] chap_password                  = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] chap_username                  =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_internal_tenant_project_id = 7657ba1a65734e77a25bcbc0be78c59f {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_internal_tenant_user_id = 38a2c9ed510a41b9b508c5e9b2fceea9 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cluster                        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] compression_format             = gzip {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] compute_api_class              = cinder.compute.nova.API {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] config_dir                     = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] config_source                  = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] control_exchange               = openstack {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] debug                          = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] default_availability_zone      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] default_group_type             = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] default_volume_type            = QuobyteHD {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] disk_geometry                  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] driver_client_cert             = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] driver_client_cert_key         = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] driver_data_namespace          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] driver_ssl_cert_path           = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] driver_ssl_cert_verify         = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] driver_use_ssl                 = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] enable_new_services            = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] enable_unsupported_driver      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] enabled_backends               = ['QuobyteHD'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] enforce_multipath_for_image_xfer = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] filter_function                = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_api_insecure            = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_api_ssl_compression     = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_ca_certificates_file    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_catalog_info            = image:glance:publicURL {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_certfile                = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_keyfile                 = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_num_retries             = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance_request_timeout         = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] goodness_function              = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] graceful_shutdown_timeout      = 5 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] group_api_class                = cinder.group.api.API {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] host                           = devstack {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_compress_on_upload       = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_conversion_address_space_limit = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.remotefs [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83223) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_conversion_cpu_limit     = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_conversion_disable       = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_upload_use_cinder_backend = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_upload_use_internal_tenant = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_volume_cache_enabled     = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_volume_cache_max_count   = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] image_volume_cache_max_size_gb = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] init_host_max_objects_retrieval = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] instance_format                = [instance: %(uuid)s]  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] iscsi_target_flags             =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] iscsi_write_cache              = on {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] iser_helper                    = tgtadm {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] iser_ip_address                = 192.168.122.169 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] iser_port                      = 3260 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_color                      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_config_append              = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_dir                        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_file                       = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_options                    = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_rotate_interval            = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_rotate_interval_type       = days {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] log_rotation_type              = none {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] max_age                        = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] max_logfile_count              = 30 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] max_logfile_size_mb            = 200 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] max_over_subscription_ratio    = 20.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] message_reap_interval          = 86400 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] message_ttl                    = 2592000 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] migration_create_volume_timeout_secs = 300 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] monkey_patch                   = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] monkey_patch_modules           = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] my_ip                          = 192.168.122.169 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] no_snapshot_gb_quota           = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] num_iser_scan_tries            = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] num_shell_tries                = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] num_volume_device_scan_tries   = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] nvmeof_conn_info_version       = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] nvmet_ns_id                    = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] nvmet_port_id                  = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] osapi_max_limit                = 1000 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] osapi_volume_ext_list          = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] osapi_volume_listen_port       = 8776 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] osapi_volume_use_ssl           = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] osapi_volume_workers           = 2 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] per_volume_size_limit          = -1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] periodic_fuzzy_delay           = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] periodic_interval              = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] public_endpoint                = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] publish_errors                 = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] quota_backup_gigabytes         = 1000 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] quota_backups                  = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] quota_gigabytes                = 1000 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] quota_groups                   = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] quota_snapshots                = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] quota_volumes                  = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] rate_limit_burst               = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] rate_limit_except_level        = CRITICAL {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] rate_limit_interval            = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] reinit_driver_count            = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] replication_device             = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] report_discard_supported       = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] report_interval                = 120 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] reservation_clean_interval     = 86400 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] reservation_expire             = 86400 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] reserved_image_namespaces      = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] reserved_percentage            = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] rpc_response_timeout           = 120 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] run_external_periodic_tasks    = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83223) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 09:04:04 devstack cinder-volume[83223]: WARNING cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 09:04:04 devstack cinder-volume[83223]: WARNING cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Running cmd (subprocess): mount.quobyte {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] scst_target_driver             = iscsi {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] scst_target_iqn_name           = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_down_time              = 720 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] shell_completion               = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] snapshot_name_template         = snapshot-%s {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] split_loggers                  = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] state_path                     = /opt/stack/data/cinder {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] storage_availability_zone      = nova {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] storage_protocol               = iSCSI {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] syslog_log_facility            = LOG_USER {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] target_helper                  = lioadm {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] target_ip_address              = 192.168.122.169 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] target_port                    = 3260 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] target_protocol                = iscsi {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] target_secondary_ip_addresses  = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] trace_flags                    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] transport_url                  = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] until_refresh                  = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] use_chap_auth                  = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] use_default_quota_class        = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] use_journal                    = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] use_json                       = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] use_multipath_for_image_xfer   = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] use_stderr                     = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] use_syslog                     = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] verify_glance_signatures       = enabled {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_api_class               = cinder.volume.api.API {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_backend_name            = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_clear                   = zero {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_clear_ionice            = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_clear_size              = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_copy_bps_limit          = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_dd_blocksize            = 1M {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_name_template           = volume-%s {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_service_inithost_offload = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volume_usage_audit_period      = month {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] zoning_mode                    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_concurrency.disable_process_locking = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.admin_password = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.admin_token = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.admin_user  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_port   = 35357 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_protocol = https {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_section = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_type   = password {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_uri    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.auth_version = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.cache       = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.certfile    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.delay_auth_decision = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.http_connect_timeout = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.identity_uri = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.include_service_catalog = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.insecure    = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.interface   = public {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.keyfile     = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_password =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcache_username =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.region_name = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.service_token_roles_required = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.service_type = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.token_cache_time = 300 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.backend                  = dogpile.cache.null {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.backend_argument         = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.backend_expiration_time  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.config_prefix            = cache.oslo {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.debug_cache_backend      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.enable_retry_client      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.enable_socket_keepalive  = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.enabled                  = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.enforce_fips_mode        = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.expiration_time          = 600 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.hashclient_retry_attempts = 2 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.memcache_dead_retry      = 300 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.memcache_pool_maxsize    = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.memcache_sasl_enabled    = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.password                 = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.proxies                  = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.redis_db                 = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.redis_sentinel_service_name = mymaster {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.redis_server             = localhost:6379 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.retry_attempts           = 2 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.retry_delay              = 0.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.socket_keepalive_count   = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.socket_keepalive_idle    = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.socket_keepalive_interval = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.socket_timeout           = 1.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.tls_allowed_ciphers      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.tls_cafile               = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.tls_certfile             = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.tls_enabled              = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.tls_keyfile              = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cache.username                 = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] coordination.backend_url       = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.asyncio_connection    = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.asyncio_slave_connection = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.backend               = sqlalchemy {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.connection            = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.connection_debug      = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.connection_parameters =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.connection_recycle_time = 3600 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.connection_trace      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.db_inc_retry_interval = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.db_max_retries        = 20 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.db_max_retry_interval = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.db_retry_interval     = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.max_overflow          = 50 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.max_pool_size         = 5 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.max_retries           = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.mysql_wsrep_sync_wait = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.pool_timeout          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.retry_interval        = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.slave_connection      = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.sqlite_synchronous    = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.synchronous_reader    = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] database.use_db_reconnect      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack quobyte-client[83252]: Reading configuration file: /etc/quobyte/client.cfg
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.connection_string     = messaging:// {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.enabled               = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack quobyte-client[83252]: Invalid parameters found, error: missing mount point.
Apr 29 09:04:04 devstack quobyte-client[83252]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 29 09:04:04 devstack quobyte-client[83252]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.es_doc_type           = notification {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.es_scroll_size        = 10000 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.es_scroll_time        = 2m {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.filter_error_trace    = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.hmac_keys             = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.sentinel_service_name = mymaster {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.socket_timeout        = 0.1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.trace_requests        = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler.trace_sqlalchemy      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler_jaeger.process_tags   = {} {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler_jaeger.service_name_prefix = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] profiler_otlp.service_name_prefix = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.enforce_new_defaults = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: WARNING oslo_config.cfg [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.enforce_scope      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.policy_default_rule = default {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.policy_file        = policy.yaml {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] privsep_osbrick.group          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] CMD "mount.quobyte" returned: 1 in 0.187s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] privsep_osbrick.helper_command = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] privsep_osbrick.user           = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_sys_admin.group         = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_sys_admin.helper_command = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[83223]: INFO cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d ...
Apr 29 09:04:04 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 -c /etc/quobyte/client-cinder.cfg {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] cinder_sys_admin.user          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.auth_section      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.auth_type         = password {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.cafile            = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.certfile          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.collect_timing    = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.insecure          = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.keyfile           = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.send_service_user_token = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.split_loggers     = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] service_user.timeout           = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.auth_section            = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.auth_type               = password {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.certfile                = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.collect_timing          = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.insecure                = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.keyfile                 = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.region_name             = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.split_loggers           = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] glance.timeout                 = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.backend_availability_zone = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.chap_password = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.chap_username =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.disk_geometry = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.driver_client_cert = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.driver_client_cert_key = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.driver_data_namespace = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.driver_use_ssl = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.enable_unsupported_driver = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.extra_capabilities = {} {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.filter_function = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.goodness_function = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.iscsi_target_flags =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.iscsi_write_cache = on {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.iser_helper   = tgtadm {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.iser_port     = 3260 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_host      =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_login     = admin {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_mount_options = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_password  = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_private_key =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_share_path =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.num_shell_tries = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.nvmet_port_id = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.quobyte_client_cfg = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.quobyte_volume_url = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.replication_device = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.report_discard_supported = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.reserved_percentage = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.scst_target_driver = iscsi {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.scst_target_iqn_name = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.storage_protocol = iSCSI {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.target_helper = tgtadm {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.target_port   = 3260 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.target_protocol = iscsi {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.trace_flags   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.unique_fqdn_network = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.use_chap_auth = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_backend_name = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_clear  = zero {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_clear_ionice = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_clear_size = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_reports.file_event_handler = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_reports.log_dir           = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.backend_availability_zone = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.backend_host         = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.chap_password        = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.chap_username        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.chiscsi_conf         = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.disk_geometry        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.driver_client_cert   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.driver_client_cert_key = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.driver_data_namespace = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack sudo[83253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 -c /etc/quobyte/client-cinder.cfg
Apr 29 09:04:04 devstack sudo[83253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.driver_use_ssl       = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.extra_capabilities   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.filter_function      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.goodness_function    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.iser_helper          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.iser_ip_address      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.iser_port            = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.iser_target_prefix   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_host             = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_login            = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_mount_options    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_password         = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_private_key      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_share_path       = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_ssh_port         = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.num_shell_tries      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.nvmet_port_id        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.replication_device   = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.report_discard_supported = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.reserved_percentage  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.scst_target_driver   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:04 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.storage_protocol     = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.target_helper        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.target_ip_address    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.target_port          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.target_prefix        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.target_protocol      = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.trace_flags          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.use_chap_auth        = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_clear         = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_clear_size    = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] QuobyteHD.volumes_dir          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.ssl      = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_notifications.driver = [] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_notifications.retry = -1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] oslo_messaging_notifications.transport_url = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] key_manager.fixed_key          = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.barbican_api_version  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.barbican_endpoint     = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.barbican_endpoint_type = public {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.barbican_region_name  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.cafile                = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.certfile              = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.collect_timing        = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.insecure              = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.keyfile               = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.number_of_retries     = 60 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.retry_delay           = 1 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.send_service_user_token = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.split_loggers         = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.timeout               = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.verify_ssl            = True {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican.verify_ssl_path       = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.auth_section = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.auth_type = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.cafile   = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.certfile = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.collect_timing = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.insecure = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.keyfile  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.split_loggers = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] barbican_service_user.timeout  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.approle_role_id          = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.approle_secret_id        = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.kv_mountpoint            = secret {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.kv_path                  = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.kv_version               = 2 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.namespace                = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.root_token_id            = **** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.ssl_ca_crt_file          = None {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.timeout                  = 60.0 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.use_ssl                  = False {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:05 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] ******************************************************************************** {{(pid=82969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 09:04:05 devstack sudo[83253]: pam_unix(sudo:session): session closed for user root
Apr 29 09:04:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.899s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:05 devstack cinder-volume[83223]: INFO cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d succeeded
Apr 29 09:04:05 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:04:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.920s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:04:05 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:05 devstack sudo[83343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:04:05 devstack sudo[83343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:04:06 devstack sudo[83343]: pam_unix(sudo:session): session closed for user root
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.593s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:06 devstack cinder-volume[83223]: INFO cinder.volume.driver [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.driver [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.588291168213, 'free_capacity_gb': 1775.588291168213, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83223) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG oslo_db.sqlalchemy.engines [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG dbcounter [-] [83223] Writer thread running {{(pid=83223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG cinder.db.sqlalchemy.api [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Building query based on filter {{(pid=83223) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG cinder.image.image_utils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83223) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 09:04:06 devstack cinder-volume[83223]: INFO cinder.keymgr.migration [None req-5cbd0404-f4f5-49c8-9b81-5803d4bc25da None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:04:06 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:06 devstack sudo[83360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:04:06 devstack sudo[83360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:04:07 devstack sudo[83360]: pam_unix(sudo:session): session closed for user root
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.637s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG cinder.manager [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Notifying Schedulers of capabilities ... {{(pid=83223) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:04:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Driver initialization completed successfully.
Apr 29 09:04:07 devstack cinder-volume[83223]: INFO cinder.manager [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Initiating service 3 cleanup
Apr 29 09:04:07 devstack cinder-volume[83223]: INFO cinder.manager [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Service 3 cleanup completed.
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG cinder.service [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Creating RPC server for service cinder-volume {{(pid=83223) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG cinder.service [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83223) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 09:04:07 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83223) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG cinder.volume.drivers.quobyte [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83223) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83223) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:04:07 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:07 devstack sudo[83376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:04:07 devstack sudo[83376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:04:08 devstack sudo[83376]: pam_unix(sudo:session): session closed for user root
Apr 29 09:04:08 devstack cinder-volume[83223]: DEBUG oslo_concurrency.processutils [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.818s {{(pid=83223) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:08 devstack cinder-volume[83223]: INFO cinder.volume.manager [None req-70726826-7cd1-4140-8d46-e8b09de1e68b None None] Driver post RPC initialization completed successfully.
Apr 29 09:04:11 devstack cinder-volume[82969]: INFO oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Caught SIGTERM, stopping children
Apr 29 09:04:11 devstack cinder-volume[82969]: DEBUG oslo_concurrency.lockutils [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Acquiring lock "singleton_lock" {{(pid=82969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 09:04:11 devstack cinder-volume[82969]: DEBUG oslo_concurrency.lockutils [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Acquired lock "singleton_lock" {{(pid=82969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 09:04:11 devstack cinder-volume[82969]: DEBUG oslo_concurrency.lockutils [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Releasing lock "singleton_lock" {{(pid=82969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 09:04:11 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Stop services. {{(pid=82969) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 29 09:04:11 devstack cinder-volume[82969]: DEBUG oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Killing children. {{(pid=82969) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 29 09:04:11 devstack cinder-volume[82969]: INFO oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Waiting on 1 children to exit
Apr 29 09:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Acquiring lock "singleton_lock" {{(pid=83223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 09:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Acquired lock "singleton_lock" {{(pid=83223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 09:04:15 devstack cinder-volume[83223]: DEBUG oslo_concurrency.lockutils [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Releasing lock "singleton_lock" {{(pid=83223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 09:04:15 devstack cinder-volume[83223]: WARNING amqp [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 09:04:15 devstack cinder-volume[83223]: WARNING amqp [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 29 09:04:15 devstack cinder-volume[82969]: INFO oslo_service.backend._eventlet.service [None req-04accf79-bc29-4154-8015-3556f81c547b None None] Child 83223 exited with status 0
Apr 29 09:04:18 devstack cinder-volume[83634]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83634) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 29 09:04:18 devstack cinder-volume[83634]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83634) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 29 09:04:18 devstack cinder-volume[83634]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83634) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 29 09:04:19 devstack cinder-volume[83634]: INFO dbcounter [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Registered counter for database cinder
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_db.sqlalchemy.engines [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83634) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG dbcounter [-] [83634] Writer thread running {{(pid=83634) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 09:04:19 devstack cinder-volume[83634]: INFO cinder.rpc [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 29 09:04:19 devstack cinder-volume[83634]: INFO cinder.rpc [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_db.sqlalchemy.engines [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83634) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:19 devstack cinder-volume[83634]: INFO cinder.volume.manager [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Determined volume DB was empty at startup.
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG cinder.volume.manager [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83634) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 29 09:04:19 devstack cinder-volume[83634]: WARNING stevedore.named [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 29 09:04:19 devstack cinder-volume[83634]: WARNING castellan.key_manager [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 09:04:19 devstack cinder-volume[83634]: WARNING cinder.keymgr.conf_key_mgr [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 29 09:04:19 devstack cinder-volume[83634]: INFO cinder.volume.manager [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_db.sqlalchemy.engines [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83634) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:19 devstack cinder-volume[83634]: INFO oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Starting 1 workers
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Started child 83863 {{(pid=83634) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Full set of CONF: {{(pid=83634) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] ******************************************************************************** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Configuration options gathered from: {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] ================================================================================ {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] allow_availability_zone_fallback = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] allow_compression_on_image_upload = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] allowed_direct_url_schemes     = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] api_rate_limit                 = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] auth_strategy                  = keystone {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_availability_zone      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_host                   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_name                   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_stats_polling_interval = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backup_api_class               = cinder.backup.api.API {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83863]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backup_name_template           = backup-%s {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backup_use_same_host           = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backup_use_temp_snapshot       = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] chap_password                  = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] chap_username                  =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_internal_tenant_project_id = 7657ba1a65734e77a25bcbc0be78c59f {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_internal_tenant_user_id = 38a2c9ed510a41b9b508c5e9b2fceea9 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cluster                        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] compression_format             = gzip {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] config_dir                     = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] config_source                  = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] control_exchange               = openstack {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] debug                          = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] default_availability_zone      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] default_group_type             = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] default_volume_type            = QuobyteHD {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] disk_geometry                  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] driver_client_cert             = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] driver_client_cert_key         = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] driver_data_namespace          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] driver_ssl_cert_path           = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] driver_ssl_cert_verify         = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] driver_use_ssl                 = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] enable_new_services            = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] enable_unsupported_driver      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] enforce_multipath_for_image_xfer = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] filter_function                = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_api_insecure            = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_api_ssl_compression     = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_ca_certificates_file    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_certfile                = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_keyfile                 = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_num_retries             = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance_request_timeout         = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] goodness_function              = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] graceful_shutdown_timeout      = 5 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] group_api_class                = cinder.group.api.API {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] host                           = devstack {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_compress_on_upload       = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_conversion_address_space_limit = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_conversion_cpu_limit     = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_conversion_disable       = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_upload_use_cinder_backend = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_upload_use_internal_tenant = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_volume_cache_enabled     = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_volume_cache_max_count   = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] image_volume_cache_max_size_gb = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] init_host_max_objects_retrieval = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] iscsi_target_flags             =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] iscsi_write_cache              = on {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] iser_helper                    = tgtadm {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] iser_ip_address                = 192.168.122.169 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] iser_port                      = 3260 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_color                      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_config_append              = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_dir                        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_file                       = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_options                    = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_rotate_interval            = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_rotate_interval_type       = days {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] log_rotation_type              = none {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] max_age                        = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] max_logfile_count              = 30 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] max_logfile_size_mb            = 200 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] max_over_subscription_ratio    = 20.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] message_reap_interval          = 86400 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] message_ttl                    = 2592000 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] migration_create_volume_timeout_secs = 300 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] monkey_patch                   = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] monkey_patch_modules           = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] my_ip                          = 192.168.122.169 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] no_snapshot_gb_quota           = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] num_iser_scan_tries            = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] num_shell_tries                = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] num_volume_device_scan_tries   = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] nvmeof_conn_info_version       = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] nvmet_ns_id                    = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] nvmet_port_id                  = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] osapi_max_limit                = 1000 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] osapi_volume_ext_list          = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] osapi_volume_listen_port       = 8776 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] osapi_volume_use_ssl           = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] osapi_volume_workers           = 2 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] per_volume_size_limit          = -1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] periodic_fuzzy_delay           = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] periodic_interval              = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83863) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] public_endpoint                = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] publish_errors                 = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] quota_backup_gigabytes         = 1000 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] quota_backups                  = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] quota_gigabytes                = 1000 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] quota_groups                   = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] quota_snapshots                = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] quota_volumes                  = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] rate_limit_burst               = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] rate_limit_except_level        = CRITICAL {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] rate_limit_interval            = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] reinit_driver_count            = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] replication_device             = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] report_discard_supported       = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] report_interval                = 120 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] reservation_clean_interval     = 86400 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] reservation_expire             = 86400 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] reserved_image_namespaces      = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] reserved_percentage            = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] rpc_response_timeout           = 120 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] run_external_periodic_tasks    = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] scst_target_driver             = iscsi {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] scst_target_iqn_name           = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_down_time              = 720 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] shell_completion               = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] snapshot_name_template         = snapshot-%s {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] split_loggers                  = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] state_path                     = /opt/stack/data/cinder {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] storage_availability_zone      = nova {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] storage_protocol               = iSCSI {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] syslog_log_facility            = LOG_USER {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] target_helper                  = lioadm {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] target_ip_address              = 192.168.122.169 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] target_port                    = 3260 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] target_protocol                = iscsi {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] target_secondary_ip_addresses  = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] trace_flags                    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] transport_url                  = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] until_refresh                  = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] use_chap_auth                  = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] use_default_quota_class        = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] use_journal                    = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] use_json                       = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] use_multipath_for_image_xfer   = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] use_stderr                     = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] use_syslog                     = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] verify_glance_signatures       = enabled {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_api_class               = cinder.volume.api.API {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_backend_name            = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_clear                   = zero {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_clear_ionice            = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_clear_size              = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_copy_bps_limit          = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_dd_blocksize            = 1M {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_name_template           = volume-%s {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_service_inithost_offload = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volume_usage_audit_period      = month {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] zoning_mode                    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_concurrency.disable_process_locking = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.admin_password = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.admin_token = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.admin_user  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_protocol = https {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_section = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_type   = password {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_uri    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.auth_version = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.cache       = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.certfile    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.identity_uri = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.include_service_catalog = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.insecure    = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.interface   = public {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.keyfile     = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_password =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcache_username =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.region_name = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.service_type = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.backend                  = dogpile.cache.null {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.backend_argument         = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.backend_expiration_time  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.config_prefix            = cache.oslo {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.debug_cache_backend      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.enable_retry_client      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.enable_socket_keepalive  = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.enabled                  = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.enforce_fips_mode        = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.expiration_time          = 600 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.hashclient_retry_attempts = 2 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.memcache_dead_retry      = 300 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.memcache_sasl_enabled    = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.password                 = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.proxies                  = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.redis_db                 = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.redis_server             = localhost:6379 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.retry_attempts           = 2 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.retry_delay              = 0.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.socket_keepalive_count   = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.socket_keepalive_idle    = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.socket_keepalive_interval = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.socket_timeout           = 1.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.tls_allowed_ciphers      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.tls_cafile               = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.tls_certfile             = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.tls_enabled              = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.tls_keyfile              = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cache.username                 = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] coordination.backend_url       = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.asyncio_connection    = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.asyncio_slave_connection = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.backend               = sqlalchemy {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.connection            = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.connection_debug      = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.connection_parameters =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.connection_recycle_time = 3600 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.connection_trace      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.db_inc_retry_interval = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.db_max_retries        = 20 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.db_max_retry_interval = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.db_retry_interval     = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.max_overflow          = 50 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.max_pool_size         = 5 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.max_retries           = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.mysql_wsrep_sync_wait = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.pool_timeout          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.retry_interval        = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.slave_connection      = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.sqlite_synchronous    = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.synchronous_reader    = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] database.use_db_reconnect      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.connection_string     = messaging:// {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.enabled               = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.es_doc_type           = notification {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.es_scroll_size        = 10000 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.es_scroll_time        = 2m {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.filter_error_trace    = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.hmac_keys             = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.sentinel_service_name = mymaster {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.socket_timeout        = 0.1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83863) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.trace_requests        = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler.trace_sqlalchemy      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler_jaeger.process_tags   = {} {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler_jaeger.service_name_prefix = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] profiler_otlp.service_name_prefix = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.enforce_new_defaults = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: WARNING oslo_config.cfg [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.enforce_scope      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.policy_default_rule = default {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Running cmd (subprocess): mount.quobyte {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] privsep_osbrick.group          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] privsep_osbrick.helper_command = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] privsep_osbrick.user           = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_sys_admin.group         = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_sys_admin.helper_command = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] cinder_sys_admin.user          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.auth_section      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.auth_type         = password {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.cafile            = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.certfile          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.collect_timing    = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.insecure          = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.keyfile           = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.send_service_user_token = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.split_loggers     = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] service_user.timeout           = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.auth_section            = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.auth_type               = password {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.certfile                = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.collect_timing          = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.insecure                = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.keyfile                 = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.region_name             = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.split_loggers           = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] glance.timeout                 = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.backend_availability_zone = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.chap_password = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.chap_username =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.disk_geometry = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.driver_client_cert = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.driver_client_cert_key = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.driver_data_namespace = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.driver_use_ssl = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.extra_capabilities = {} {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.filter_function = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.goodness_function = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.iscsi_target_flags =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.iscsi_write_cache = on {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.iser_port     = 3260 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_host      =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_login     = admin {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_mount_options = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_password  = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_private_key =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_share_path =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.num_shell_tries = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.quobyte_volume_url = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.replication_device = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.report_discard_supported = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.reserved_percentage = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.target_helper = tgtadm {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.target_port   = 3260 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.target_protocol = iscsi {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.trace_flags   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.unique_fqdn_network = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.use_chap_auth = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_backend_name = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_clear  = zero {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_clear_ionice = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_clear_size = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_reports.file_event_handler = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_reports.log_dir           = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.backend_availability_zone = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.backend_host         = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:19 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.chap_password        = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.chap_username        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.disk_geometry        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.driver_client_cert   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.driver_data_namespace = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.extra_capabilities   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.filter_function      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.goodness_function    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.iser_helper          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.iser_ip_address      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.iser_port            = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_host             = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_login            = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_mount_options    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_password         = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_private_key      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_share_path       = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.num_shell_tries      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.replication_device   = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.report_discard_supported = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.reserved_percentage  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.scst_target_driver   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.storage_protocol     = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.target_helper        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.target_ip_address    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.target_port          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.target_prefix        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.target_protocol      = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.trace_flags          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.use_chap_auth        = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_clear         = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_clear_size    = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack quobyte-client[83873]: Reading configuration file: /etc/quobyte/client.cfg
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] QuobyteHD.volumes_dir          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack quobyte-client[83873]: Invalid parameters found, error: missing mount point.
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack quobyte-client[83873]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack quobyte-client[83873]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_notifications.driver = [] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_notifications.retry = -1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] key_manager.fixed_key          = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.barbican_api_version  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.barbican_endpoint     = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.barbican_endpoint_type = public {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.barbican_region_name  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.cafile                = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.certfile              = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.collect_timing        = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.insecure              = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.keyfile               = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.number_of_retries     = 60 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.retry_delay           = 1 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.send_service_user_token = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.split_loggers         = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.timeout               = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.verify_ssl            = True {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican.verify_ssl_path       = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.auth_section = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.auth_type = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.cafile   = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.certfile = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.collect_timing = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.insecure = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.keyfile  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.split_loggers = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] barbican_service_user.timeout  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.approle_role_id          = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.approle_secret_id        = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.kv_mountpoint            = secret {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.kv_path                  = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.kv_version               = 2 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.namespace                = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.root_token_id            = **** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.ssl_ca_crt_file          = None {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.timeout                  = 60.0 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.use_ssl                  = False {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 29 09:04:20 devstack cinder-volume[83634]: DEBUG oslo_service.backend._eventlet.service [None req-faf263e8-8564-47bc-b00e-99f7cab54cd9 None None] ******************************************************************************** {{(pid=83634) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 29 09:04:20 devstack sudo[83891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:04:20 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.696s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:20 devstack cinder-volume[83863]: INFO cinder.volume.driver [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Driver hasn't implemented _init_vendor_properties()
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG cinder.volume.driver [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6306228637695, 'free_capacity_gb': 1775.6306228637695, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83863) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 29 09:04:20 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_db.sqlalchemy.engines [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writer thread running {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG cinder.db.sqlalchemy.api [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Building query based on filter {{(pid=83863) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83863) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:04:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:20 devstack cinder-volume[83863]: INFO cinder.keymgr.migration [None req-bac83595-26f0-4a1f-81b2-6989779b4b7f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 29 09:04:20 devstack sudo[83899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:04:20 devstack sudo[83899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:04:21 devstack sudo[83899]: pam_unix(sudo:session): session closed for user root
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.569s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:04:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Driver initialization completed successfully.
Apr 29 09:04:21 devstack cinder-volume[83863]: INFO cinder.manager [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Initiating service 3 cleanup
Apr 29 09:04:21 devstack cinder-volume[83863]: INFO cinder.manager [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Service 3 cleanup completed.
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG cinder.service [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Creating RPC server for service cinder-volume {{(pid=83863) start /opt/stack/cinder/cinder/service.py:231}}
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG cinder.service [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83863) start /opt/stack/cinder/cinder/service.py:237}}
Apr 29 09:04:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:04:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:04:21 devstack sudo[83902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:04:21 devstack sudo[83902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:04:22 devstack sudo[83902]: pam_unix(sudo:session): session closed for user root
Apr 29 09:04:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.582s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:04:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-30a556e1-557d-4a71-8592-401d3890ad58 None None] Driver post RPC initialization completed successfully.
Apr 29 09:04:29 devstack cinder-volume[83634]: DEBUG dbcounter [-] [83634] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83634) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:04:31 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:04:32 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=3 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Flow 'volume_create_manager' (436455b2-d44e-47ff-a9d7-daaec6e94e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ffffef-b175-493a-b61a-ac0ca78f7e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ffffef-b175-493a-b61a-ac0ca78f7e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-368785111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89fea45-1479-4f85-86c7-f788f5db872a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45965e728e924e31b56aaa723cb47d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:19Z,use_quota=True,user_id='880b0a37c03243fc9588c04fd3b223c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d40d454-f4a8-4a43-b832-ff9552100df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d40d454-f4a8-4a43-b832-ff9552100df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0590c3fd-dd89-49a6-a23d-9dded5896589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0590c3fd-dd89-49a6-a23d-9dded5896589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89fea45-1479-4f85-86c7-f788f5db872a', 'volume_name': 'volume-c89fea45-1479-4f85-86c7-f788f5db872a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750e9b53-75ea-49df-a31d-1a8b3438499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750e9b53-75ea-49df-a31d-1a8b3438499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caab174d-6bf9-4661-abd2-7de3a20d2ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Volume c89fea45-1479-4f85-86c7-f788f5db872a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89fea45-1479-4f85-86c7-f788f5db872a', 'volume_size': 1}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-368785111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89fea45-1479-4f85-86c7-f788f5db872a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45965e728e924e31b56aaa723cb47d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:19Z,use_quota=True,user_id='880b0a37c03243fc9588c04fd3b223c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Creating volume c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:05:19 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:05:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:19 devstack sudo[84172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a 1073741824
Apr 29 09:05:19 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:21 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a 1073741824" returned: 0 in 1.491s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:21 devstack sudo[84497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a
Apr 29 09:05:21 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:22 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a" returned: 0 in 0.857s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] <== create_volume: return (2419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:05:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.422s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caab174d-6bf9-4661-abd2-7de3a20d2ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89fea45-1479-4f85-86c7-f788f5db872a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84867880-8bdb-4021-9b00-9ef9f8b110c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:22 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Volume volume-c89fea45-1479-4f85-86c7-f788f5db872a (c89fea45-1479-4f85-86c7-f788f5db872a): created successfully
Apr 29 09:05:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84867880-8bdb-4021-9b00-9ef9f8b110c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Flow 'volume_create_manager' (436455b2-d44e-47ff-a9d7-daaec6e94e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:05:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-ea166ce7-cfce-4177-96e7-70caaafa127a req-b9931d93-45ba-4091-979f-9c78401fcb53 tempest-VolumesSnapshotsTestJSON-1521069865 None] Created volume successfully.
Apr 29 09:05:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Creating offline snapshot 02b44356-efe3-4c5a-a06a-e8b7ca31f82d of volume c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:05:24 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyf0d2gbk/privsep.sock']
Apr 29 09:05:24 devstack sudo[84515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyf0d2gbk/privsep.sock
Apr 29 09:05:24 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:26 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:26 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Spawned new privsep daemon via rootwrap
Apr 29 09:05:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Accepted privsep connection to /tmp/tmpyf0d2gbk/privsep.sock {{(pid=83863) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}}
Apr 29 09:05:26 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 29 09:05:26 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 29 09:05:26 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 29 09:05:26 devstack cinder-volume[83863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84585
Apr 29 09:05:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad67a98a-1f26-4c22-9f1c-18c6c5cbd4a7]: (2,) {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:05:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b8fa19-9962-4791-a802-22312af48de1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:05:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:26 devstack sudo[84605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a
Apr 29 09:05:26 devstack sudo[84605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:27 devstack sudo[84605]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a" returned: 0 in 1.195s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:27 devstack sudo[84614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d 1G
Apr 29 09:05:27 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:29 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d 1G" returned: 0 in 1.273s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89fea45-1479-4f85-86c7-f788f5db872a -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:29 devstack sudo[84621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89fea45-1479-4f85-86c7-f788f5db872a -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d
Apr 29 09:05:29 devstack sudo[84621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:30 devstack sudo[84621]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89fea45-1479-4f85-86c7-f788f5db872a -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d" returned: 0 in 1.410s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:30 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d is being set with open permissions: ugo+rw
Apr 29 09:05:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:30 devstack sudo[84631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d
Apr 29 09:05:30 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:32 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d" returned: 0 in 2.358s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:33 devstack sudo[84650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.info
Apr 29 09:05:33 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:34 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.info" returned: 0 in 1.510s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:34 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.info is being set with open permissions: ugo+rw
Apr 29 09:05:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:34 devstack sudo[84655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.info
Apr 29 09:05:34 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:35 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.info" returned: 0 in 1.168s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 11.668s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-1f5590d4-b1a9-4f3f-80aa-6a932d814b94 req-3236e00d-d43f-43df-bc02-837ddb206bda tempest-VolumesSnapshotsTestJSON-1521069865 None] Create snapshot completed successfully
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "cinder-02b44356-efe3-4c5a-a06a-e8b7ca31f82d-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-02b44356-efe3-4c5a-a06a-e8b7ca31f82d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "cinder-quobyte-c89fea45-1479-4f85-86c7-f788f5db872a" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-quobyte-c89fea45-1479-4f85-86c7-f788f5db872a" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "cinder-quobyte-02b44356-efe3-4c5a-a06a-e8b7ca31f82d" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-quobyte-02b44356-efe3-4c5a-a06a-e8b7ca31f82d" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Deleting offline snapshot 02b44356-efe3-4c5a-a06a-e8b7ca31f82d of volume c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] snapshot_file for this snap is: volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff5a64c-f572-4bbd-a0e5-c0fc0b8eddbc]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:05:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:38 devstack sudo[84700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d
Apr 29 09:05:38 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:39 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d" returned: 0 in 1.287s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c89fea45-1479-4f85-86c7-f788f5db872a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:05:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee275f4-443b-48b1-98a4-fbaa66ef1e8c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:05:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:39 devstack sudo[84782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a
Apr 29 09:05:39 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:41 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a" returned: 0 in 2.219s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:41 devstack sudo[84813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d
Apr 29 09:05:41 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:42 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d" returned: 0 in 1.264s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:42 devstack sudo[84819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d
Apr 29 09:05:42 devstack sudo[84819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:44 devstack sudo[84819]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a.02b44356-efe3-4c5a-a06a-e8b7ca31f82d" returned: 0 in 2.031s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-quobyte-02b44356-efe3-4c5a-a06a-e8b7ca31f82d" released by "_delete_snapshot" :: held 7.049s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:05:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-quobyte-c89fea45-1479-4f85-86c7-f788f5db872a" released by "delete_snapshot" :: held 7.107s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:05:45 devstack cinder-volume[83863]: WARNING cinder.quota [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:05:45 devstack cinder-volume[83863]: WARNING cinder.quota [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.quota [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Created reservations ['1cfe194c-c7a6-491d-bfc7-5fdfa96de7a5', 'c9d25a40-869d-4880-836d-8988f3f33e41', '966dc79d-2326-4952-93f2-4b9ca9dd4a4a', '62725d8a-9dd4-477d-baf3-d17dfbfe6b3b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:05:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Delete snapshot completed successfully.
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8dbf5630-fcb1-4c37-bb11-d0e1ce586274 req-be064b93-196d-48c3-92e6-eb2fee2edda8 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-02b44356-efe3-4c5a-a06a-e8b7ca31f82d-delete_snapshot" released by "delete_snapshot" :: held 7.404s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Flow 'volume_create_manager' (bb7907b4-4959-40e9-acd5-523205ba8582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34331da-60e7-475e-b4e1-e7617a7e1cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34331da-60e7-475e-b4e1-e7617a7e1cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1637087188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b507fce2-fb87-492b-82fe-7ed18056857b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76f9b0ff9b54da9862c2626ee06e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:45Z,use_quota=True,user_id='790436cd287f4fb3b118ec884eb4a20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0928d6-8ce8-434b-93ee-84fb691580e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0928d6-8ce8-434b-93ee-84fb691580e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a953f8a-f66c-45af-a70f-f07de1904614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a953f8a-f66c-45af-a70f-f07de1904614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b507fce2-fb87-492b-82fe-7ed18056857b', 'volume_name': 'volume-b507fce2-fb87-492b-82fe-7ed18056857b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80aaf918-24e5-4f0f-a930-c6b28453e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80aaf918-24e5-4f0f-a930-c6b28453e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8dc0cb-35f4-4d1b-8013-32130e1b9a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Volume b507fce2-fb87-492b-82fe-7ed18056857b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b507fce2-fb87-492b-82fe-7ed18056857b', 'volume_size': 1}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1637087188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b507fce2-fb87-492b-82fe-7ed18056857b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76f9b0ff9b54da9862c2626ee06e42b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:45Z,use_quota=True,user_id='790436cd287f4fb3b118ec884eb4a20f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Creating volume b507fce2-fb87-492b-82fe-7ed18056857b {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:05:45 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:45 devstack sudo[84865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b 1073741824
Apr 29 09:05:45 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "cinder-c89fea45-1479-4f85-86c7-f788f5db872a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:05:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-c89fea45-1479-4f85-86c7-f788f5db872a-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:05:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "cinder-quobyte-c89fea45-1479-4f85-86c7-f788f5db872a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:05:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-quobyte-c89fea45-1479-4f85-86c7-f788f5db872a" acquired by "delete_volume" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:05:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[416c6578-68c7-4329-8d64-20c13becb59e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:05:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:46 devstack sudo[84867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a
Apr 29 09:05:46 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:48 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b 1073741824" returned: 0 in 2.288s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:48 devstack sudo[84877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b
Apr 29 09:05:48 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:48 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a" returned: 0 in 2.060s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:48 devstack sudo[84897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a
Apr 29 09:05:48 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Flow 'volume_create_manager' (635b6f45-2800-43ee-a70c-390db4b81ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77d3cc9-4ab2-4138-bedc-314d4b88cd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77d3cc9-4ab2-4138-bedc-314d4b88cd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1538410505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce16a9b1-a3a6-4456-ad89-1bfe352be75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480784ccd5af46188cab12a239ecff99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:48Z,use_quota=True,user_id='fbbdf25e585d4852aa4e0ab8c9510c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe5f742-1253-4b29-ac51-6d4a2f788d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe5f742-1253-4b29-ac51-6d4a2f788d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740cb45a-db29-4ae7-af47-88885714b19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740cb45a-db29-4ae7-af47-88885714b19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce16a9b1-a3a6-4456-ad89-1bfe352be75c', 'volume_name': 'volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aedd40-2c6b-49f2-add9-98d88bf10f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aedd40-2c6b-49f2-add9-98d88bf10f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedab0d5-99c3-4008-9538-97a8ea9cfb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:48 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Volume ce16a9b1-a3a6-4456-ad89-1bfe352be75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c', 'volume_size': 1}
Apr 29 09:05:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:49 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b" returned: 0 in 1.393s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] <== create_volume: return (3774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.777s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.604s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1538410505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce16a9b1-a3a6-4456-ad89-1bfe352be75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='480784ccd5af46188cab12a239ecff99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:05:48Z,use_quota=True,user_id='fbbdf25e585d4852aa4e0ab8c9510c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Creating volume ce16a9b1-a3a6-4456-ad89-1bfe352be75c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:05:49 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8dc0cb-35f4-4d1b-8013-32130e1b9a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b507fce2-fb87-492b-82fe-7ed18056857b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:49 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c 1073741824
Apr 29 09:05:49 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e4885f-cab2-45d4-ba72-8f0e72ce60df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Volume volume-b507fce2-fb87-492b-82fe-7ed18056857b (b507fce2-fb87-492b-82fe-7ed18056857b): created successfully
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e4885f-cab2-45d4-ba72-8f0e72ce60df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Flow 'volume_create_manager' (bb7907b4-4959-40e9-acd5-523205ba8582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:05:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b33cde1b-e3af-46f4-a1f9-05cf416d06a1 tempest-VolumesAdminNegativeTest-462535499 None] Created volume successfully.
Apr 29 09:05:50 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c89fea45-1479-4f85-86c7-f788f5db872a" returned: 0 in 1.624s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-quobyte-c89fea45-1479-4f85-86c7-f788f5db872a" released by "delete_volume" :: held 3.840s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:05:50 devstack cinder-volume[83863]: WARNING cinder.quota [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG cinder.quota [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Created reservations ['f687fedf-cb57-489e-b129-22598fbff6c3', '0e64ac12-b25d-4816-89e2-5dd5a3ca2cf3', 'e0b7544f-0c51-44a9-b06d-f1a2b4f5589e', '7cb0e982-144c-4aa6-b32c-b264f53527e5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:50 devstack sudo[84905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:05:50 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Acquiring lock "cinder-b507fce2-fb87-492b-82fe-7ed18056857b-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:05:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Lock "cinder-b507fce2-fb87-492b-82fe-7ed18056857b-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:05:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Acquiring lock "cinder-quobyte-b507fce2-fb87-492b-82fe-7ed18056857b" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:05:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Lock "cinder-quobyte-b507fce2-fb87-492b-82fe-7ed18056857b" acquired by "delete_volume" :: waited 0.052s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:05:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d8f1c-5b3b-4fe8-9913-274a083e046d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:05:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:52 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c 1073741824" returned: 0 in 2.469s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:52 devstack sudo[84910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b
Apr 29 09:05:52 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:52 devstack sudo[84912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c
Apr 29 09:05:52 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:52 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:52 devstack cinder-volume[83863]: DEBUG cinder.manager [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:05:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Deleted volume successfully.
Apr 29 09:05:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-4b01d131-6afc-462f-8786-507161b6564c req-c915f7fb-dacc-40dd-af5c-d50885320326 tempest-VolumesSnapshotsTestJSON-1521069865 None] Lock "cinder-c89fea45-1479-4f85-86c7-f788f5db872a-delete_volume" released by "delete_volume" :: held 6.301s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:05:53 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b" returned: 0 in 1.762s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:53 devstack sudo[84918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b
Apr 29 09:05:53 devstack sudo[84918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:53 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c" returned: 0 in 1.532s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] <== create_volume: return (4129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.140s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fedab0d5-99c3-4008-9538-97a8ea9cfb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65581556-aaa1-4560-a772-7e1139193c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:05:53 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Volume volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c (ce16a9b1-a3a6-4456-ad89-1bfe352be75c): created successfully
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65581556-aaa1-4560-a772-7e1139193c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:05:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Flow 'volume_create_manager' (635b6f45-2800-43ee-a70c-390db4b81ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:05:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-265e388d-f1d7-4940-891c-055c75e64796 tempest-ServerRescueNegativeTestJSON-276975695 None] Created volume successfully.
Apr 29 09:05:54 devstack sudo[84918]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b507fce2-fb87-492b-82fe-7ed18056857b" returned: 0 in 1.248s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Lock "cinder-quobyte-b507fce2-fb87-492b-82fe-7ed18056857b" released by "delete_volume" :: held 3.148s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:05:54 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Created reservations ['e05094a0-4a77-4ed0-b7d7-f069639659e2', '99a812cb-896b-48dc-8aa3-3fa4ae513620', '43b702a1-e0a4-4624-a864-db66763072a5', 'cabed878-b18a-420d-b9bb-1aa41f67f9e8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:05:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:05:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:05:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:55 devstack sudo[84923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:05:55 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:05:56 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root
Apr 29 09:05:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.452s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:05:56 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:05:56 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Deleted volume successfully.
Apr 29 09:05:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-211090da-58fe-43b6-8071-9e6ac010a7bb tempest-VolumesAdminNegativeTest-462535499 None] Lock "cinder-b507fce2-fb87-492b-82fe-7ed18056857b-delete_volume" released by "delete_volume" :: held 5.304s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:05:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:05:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:05:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:05:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:05:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:05:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:05:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:05:59 devstack sudo[84964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:05:59 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:00 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.536s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:06:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dd4e00d-4144-4301-9888-e5e625939a1b tempest-BackendsCapabilitiesAdminTestsJSON-281397982 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6306228637695, 'free_capacity_gb': 1775.6306228637695, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 09:06:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-255aeb67-061a-42b7-903c-625766657365 tempest-BackendsCapabilitiesAdminTestsJSON-281397982 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6306228637695, 'free_capacity_gb': 1775.6306228637695, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 29 09:06:05 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=31,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:06:06 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=5,cinder:SELECT=19 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:06:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6ebdf667-59db-4de9-a468-95f7cc54684a tempest-GroupsV320Test-1837629364 None] Group tempest-GroupsV320Test-Group-1286192725: creating
Apr 29 09:06:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6ebdf667-59db-4de9-a468-95f7cc54684a tempest-GroupsV320Test-1837629364 None] Group tempest-GroupsV320Test-Group-1286192725: created successfully
Apr 29 09:06:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6ebdf667-59db-4de9-a468-95f7cc54684a tempest-GroupsV320Test-1837629364 None] Create group completed successfully.
Apr 29 09:06:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Acquiring lock "cinder-ce16a9b1-a3a6-4456-ad89-1bfe352be75c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:06:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "cinder-ce16a9b1-a3a6-4456-ad89-1bfe352be75c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:06:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Acquiring lock "cinder-quobyte-ce16a9b1-a3a6-4456-ad89-1bfe352be75c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:06:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "cinder-quobyte-ce16a9b1-a3a6-4456-ad89-1bfe352be75c" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:06:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d720a702-0981-43dc-bf7c-7f9a22a2b68f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:06:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:23 devstack sudo[85198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c
Apr 29 09:06:23 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:24 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c" returned: 0 in 1.230s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:24 devstack sudo[85207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c
Apr 29 09:06:24 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Created reservations ['93c5c9f3-8dd8-4b09-9c64-adc7933ba148'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:06:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:06:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:06:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:06:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:06:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:06:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:25 devstack sudo[85227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:06:25 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:26 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ce16a9b1-a3a6-4456-ad89-1bfe352be75c" returned: 0 in 1.545s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "cinder-quobyte-ce16a9b1-a3a6-4456-ad89-1bfe352be75c" released by "delete_volume" :: held 2.872s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Created reservations ['340534c6-6a70-43c2-8547-d97686d583f2', 'c6019e1f-70e8-4865-b3a9-e972388482fa', '147b8961-371f-4246-9a48-b6f2b00211ae', '393589db-a202-49e9-bb7e-9a272ecf28d0'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:06:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:26 devstack sudo[85243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:06:26 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:27 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.147s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:27 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:06:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-053d3383-e5c4-4747-9a65-461cea91aec8 tempest-GroupsV320Test-1837629364 None] Delete group completed successfully.
Apr 29 09:06:27 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.379s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:27 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:06:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Deleted volume successfully.
Apr 29 09:06:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0a297a0b-7892-4f25-ab18-13972b283874 tempest-ServerRescueNegativeTestJSON-276975695 None] Lock "cinder-ce16a9b1-a3a6-4456-ad89-1bfe352be75c-delete_volume" released by "delete_volume" :: held 4.607s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:06:36 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:06:37 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=12,cinder:SELECT=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Flow 'volume_create_manager' (a7f6ae7b-2ece-43b5-837e-d48db16e645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1404312-51f1-4697-9baa-38fe7a380fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1404312-51f1-4697-9baa-38fe7a380fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1438888848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd60a184-c2c0-49c5-86a1-d4194e3ac8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38551f752a014891a494e10a9240aae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:41Z,use_quota=True,user_id='b1ff5e95c945425caa510ea5c4c7d0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3831f7b5-230c-424e-bbe9-d30fba8d4bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3831f7b5-230c-424e-bbe9-d30fba8d4bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2315fbc-e186-4694-9a16-aadabca7ebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2315fbc-e186-4694-9a16-aadabca7ebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd60a184-c2c0-49c5-86a1-d4194e3ac8e4', 'volume_name': 'volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb8fb7e-db0c-480c-8986-ea3b37a2c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb8fb7e-db0c-480c-8986-ea3b37a2c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a9574a-eb5a-476e-860d-aebca519642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:06:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Volume dd60a184-c2c0-49c5-86a1-d4194e3ac8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4', 'volume_size': 1}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1438888848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd60a184-c2c0-49c5-86a1-d4194e3ac8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38551f752a014891a494e10a9240aae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:06:41Z,use_quota=True,user_id='b1ff5e95c945425caa510ea5c4c7d0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Creating volume dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:06:41 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:06:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:41 devstack sudo[85401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 1073741824
Apr 29 09:06:41 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:42 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 1073741824" returned: 0 in 1.267s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:42 devstack sudo[85407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4
Apr 29 09:06:42 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:43 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4" returned: 0 in 0.946s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:06:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:06:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a9574a-eb5a-476e-860d-aebca519642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:06:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf40d8a-06a1-4e66-88a5-63f5bb40a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:06:43 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Volume volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 (dd60a184-c2c0-49c5-86a1-d4194e3ac8e4): created successfully
Apr 29 09:06:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf40d8a-06a1-4e66-88a5-63f5bb40a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:06:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Flow 'volume_create_manager' (a7f6ae7b-2ece-43b5-837e-d48db16e645a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:06:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3e66717f-038a-49ba-a706-98041f574c57 tempest-DeleteServersTestJSON-1894487958 None] Created volume successfully.
Apr 29 09:06:51 devstack cinder-volume[83863]: WARNING py.warnings [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 29 09:06:51 devstack cinder-volume[83863]:   .first()
Apr 29 09:06:51 devstack cinder-volume[83863]: 
Apr 29 09:06:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:06:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:06:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ec5f0e-5f65-4c46-aca2-b19f563ec758]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:06:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:51 devstack sudo[85457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4
Apr 29 09:06:51 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:06:52 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root
Apr 29 09:06:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4" returned: 0 in 1.086s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:06:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.109s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:06:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d', 'name': 'volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78feb288-6e13-4d8c-bb10-fb3b97bf0bcf', 'enforce_multipath': True} {{(pid=83863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 09:06:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-891fccea-719c-42e5-89a5-0434f4833ea2 req-eabde413-e104-4221-aff4-8bd3b0594fcd tempest-DeleteServersTestJSON-1894487958 None] attachment_update completed successfully.
Apr 29 09:06:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-644237ef-83ea-4f7e-bc24-3f8acd9a4f8c tempest-GroupSnapshotsV319Test-1639564490 None] Group tempest-GroupSnapshotsV319Test-Group-295958086: creating
Apr 29 09:06:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-644237ef-83ea-4f7e-bc24-3f8acd9a4f8c tempest-GroupSnapshotsV319Test-1639564490 None] Group tempest-GroupSnapshotsV319Test-Group-295958086: created successfully
Apr 29 09:06:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-644237ef-83ea-4f7e-bc24-3f8acd9a4f8c tempest-GroupSnapshotsV319Test-1639564490 None] Create group completed successfully.
Apr 29 09:06:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:06:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:06:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:06:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:06:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:06:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:06:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:06:59 devstack sudo[85869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:06:59 devstack sudo[85869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:00 devstack sudo[85869]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.250s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Flow 'volume_create_manager' (7423114f-0abb-4b71-8af6-fc27eba02462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3a33fd-4aeb-445e-b12c-fd786d666cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3a33fd-4aeb-445e-b12c-fd786d666cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1375998026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d73c917-0848-4d62-9e6e-ea3ba1528a60,host='devstack@QuobyteHD#QuobyteHD',id=59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d41b905b7e14fd19bb8913e3d6165f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:00Z,use_quota=True,user_id='4fbbf21692bb40168198a15f611fd805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b341f70-b90f-4010-a3cc-bf31215a93c8),volume_type_id=3b341f70-b90f-4010-a3cc-bf31215a93c8)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817500f0-de5a-4673-a3a5-20c370bb74af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817500f0-de5a-4673-a3a5-20c370bb74af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24783988-61d3-4f32-aea0-2d0cadd1c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24783988-61d3-4f32-aea0-2d0cadd1c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f', 'volume_name': 'volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d9ffff-953c-4465-b1f0-6b68aa0cc5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d9ffff-953c-4465-b1f0-6b68aa0cc5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ff5bbb-526e-4cef-aa24-d60f87341805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Volume 59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f', 'volume_size': 1}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1d73c917-0848-4d62-9e6e-ea3ba1528a60,created_at=2026-04-29T07:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1375998026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1d73c917-0848-4d62-9e6e-ea3ba1528a60,host='devstack@QuobyteHD#QuobyteHD',id=59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d41b905b7e14fd19bb8913e3d6165f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:00Z,use_quota=True,user_id='4fbbf21692bb40168198a15f611fd805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b341f70-b90f-4010-a3cc-bf31215a93c8),volume_type_id=3b341f70-b90f-4010-a3cc-bf31215a93c8)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Creating volume 59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:07:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:07:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:00 devstack sudo[85945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f 1073741824
Apr 29 09:07:00 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:01 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f 1073741824" returned: 0 in 0.940s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:01 devstack sudo[85952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f
Apr 29 09:07:01 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:02 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" returned: 0 in 0.686s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ff5bbb-526e-4cef-aa24-d60f87341805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6ee452-1a88-4f1f-820d-e0d7d4cfcbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Volume volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f (59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f): created successfully
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6ee452-1a88-4f1f-820d-e0d7d4cfcbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Flow 'volume_create_manager' (7423114f-0abb-4b71-8af6-fc27eba02462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-71bad378-27ab-48df-bd97-ec1b485534bb tempest-GroupSnapshotsV319Test-1639564490 None] Created volume successfully.
Apr 29 09:07:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-8bd10af0-0d47-4836-84a0-ea1cdd72aed8 req-5e3b9acb-436a-4528-abee-ffd89bf71844 tempest-DeleteServersTestJSON-1894487958 None] Terminate volume connection completed successfully.
Apr 29 09:07:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8bd10af0-0d47-4836-84a0-ea1cdd72aed8 req-5e3b9acb-436a-4528-abee-ffd89bf71844 tempest-DeleteServersTestJSON-1894487958 None] Deleting attachment 78feb288-6e13-4d8c-bb10-fb3b97bf0bcf. {{(pid=83863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 09:07:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] GroupSnapshot fcb89fb8-f136-4efc-9e2e-7e45652f7a19: creating.
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Group snapshot fcb89fb8-f136-4efc-9e2e-7e45652f7a19: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Creating offline snapshot 1019266d-9ebb-4723-ac52-4e4057baad23 of volume 59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f22fe4-2cf5-4eb2-88fd-05920261527c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:03 devstack sudo[85955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f
Apr 29 09:07:03 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:03 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" returned: 0 in 0.826s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:03 devstack sudo[85961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 1G
Apr 29 09:07:03 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:04 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 1G" returned: 0 in 0.911s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:04 devstack sudo[85971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23
Apr 29 09:07:04 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:05 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23" returned: 0 in 0.714s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:05 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:07:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:05 devstack sudo[85977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23
Apr 29 09:07:05 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:06 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23" returned: 0 in 0.873s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:06 devstack sudo[86028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.info
Apr 29 09:07:06 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Acquiring lock "cinder-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Lock "cinder-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Acquiring lock "cinder-quobyte-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Lock "cinder-quobyte-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4" acquired by "delete_volume" :: waited 0.049s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff611c-be03-4f70-ae34-aa2f867b609b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:07 devstack sudo[86044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4
Apr 29 09:07:07 devstack sudo[86044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:07 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.info" returned: 0 in 1.250s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:07 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:07:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:07 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.info
Apr 29 09:07:07 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:08 devstack sudo[86044]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4" returned: 0 in 1.029s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:08 devstack sudo[86054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4
Apr 29 09:07:08 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:08 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.info" returned: 0 in 0.816s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.535s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-55f86e6e-a839-445a-bf9e-d4e53f9d1aab tempest-GroupSnapshotsV319Test-1639564490 None] group_snapshot fcb89fb8-f136-4efc-9e2e-7e45652f7a19: created successfully
Apr 29 09:07:09 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4" returned: 0 in 0.886s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Lock "cinder-quobyte-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4" released by "delete_volume" :: held 1.982s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Created reservations ['50b3dd7a-b674-41cc-83b5-6bd65fd2517d', '1cd4f8a6-d332-43e6-9c2e-5a854f52b3ac', '30084d7f-ca86-40a3-90b1-68ee1786157b', 'c091b55c-dd1c-43a0-9de9-56258039058b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:09 devstack sudo[86057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:07:09 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] group_snapshot fcb89fb8-f136-4efc-9e2e-7e45652f7a19: deleting
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] group_snapshot fcb89fb8-f136-4efc-9e2e-7e45652f7a19: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Acquiring lock "cinder-quobyte-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Lock "cinder-quobyte-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Acquiring lock "cinder-quobyte-1019266d-9ebb-4723-ac52-4e4057baad23" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Lock "cinder-quobyte-1019266d-9ebb-4723-ac52-4e4057baad23" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Deleting offline snapshot 1019266d-9ebb-4723-ac52-4e4057baad23 of volume 59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] snapshot_file for this snap is: volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d9025-8c14-4970-9fa6-69778ee8bf47]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:10 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23
Apr 29 09:07:10 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:10 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.006s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:07:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Deleted volume successfully.
Apr 29 09:07:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e23fd55-1719-454e-9717-33877263a074 tempest-DeleteServersTestJSON-1894487958 None] Lock "cinder-dd60a184-c2c0-49c5-86a1-d4194e3ac8e4-delete_volume" released by "delete_volume" :: held 3.536s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:11 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23" returned: 0 in 1.200s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:07:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ea672-fde2-4da4-b4a4-a4e74bf2001b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:11 devstack sudo[86065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f
Apr 29 09:07:11 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:12 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" returned: 0 in 1.084s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:12 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23
Apr 29 09:07:12 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:13 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23" returned: 0 in 1.150s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:13 devstack sudo[86078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23
Apr 29 09:07:13 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:15 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f.1019266d-9ebb-4723-ac52-4e4057baad23" returned: 0 in 1.252s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Lock "cinder-quobyte-1019266d-9ebb-4723-ac52-4e4057baad23" released by "_delete_snapshot" :: held 4.874s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Lock "cinder-quobyte-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" released by "delete_snapshot" :: held 4.919s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:15 devstack cinder-volume[83863]: WARNING cinder.quota [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1239451190 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1239451190, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:07:15 devstack cinder-volume[83863]: WARNING cinder.quota [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1239451190 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1239451190, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:07:15 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] Created reservations ['503881e7-1bd5-4a7b-b57e-f2d3e5a2ad52', '018cab32-9f4a-48b0-9274-82464062f56d', '78ed8be6-822b-40b2-b5fc-7226629ccf12', '24702f7c-38c6-4d9c-bc6d-d57b23b1e662'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-90b17504-e904-46d2-927f-8256350afbf3 tempest-GroupSnapshotsV319Test-1639564490 None] group_snapshot fcb89fb8-f136-4efc-9e2e-7e45652f7a19: deleted successfully
Apr 29 09:07:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Acquiring lock "cinder-quobyte-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Lock "cinder-quobyte-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35947242-d5fe-4eb1-be54-9db83353c230]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:16 devstack sudo[86131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f
Apr 29 09:07:16 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:17 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" returned: 0 in 1.142s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:17 devstack sudo[86153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f
Apr 29 09:07:17 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:18 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" returned: 0 in 1.113s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Lock "cinder-quobyte-59bd98ad-c08c-43b7-ac30-fd06f7f8bd3f" released by "delete_volume" :: held 2.363s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:18 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Created reservations ['02e11f28-6c1c-4662-a4e4-3e6f1652b763'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:19 devstack cinder-volume[83863]: WARNING cinder.quota [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1239451190 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1239451190, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:07:19 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Created reservations ['1eee7d9d-d739-4960-9557-85a3d37d71ae', 'b2cab774-169e-4c96-bb3c-803433b2bf92', 'df7a35cf-5f84-4cde-8427-373aac18d483', 'c7efac49-2f58-4d42-babc-dc9f95cd49d2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:19 devstack sudo[86156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:07:19 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:20 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.996s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:20 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:07:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-37187b10-c3e3-4fad-9e4a-0dd1c474830d tempest-GroupSnapshotsV319Test-1639564490 None] Delete group completed successfully.
Apr 29 09:07:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6df24982-803d-421b-ade7-4ad3a82b1df9 tempest-GroupsTest-904969559 None] Group tempest-Group1-194457799: creating
Apr 29 09:07:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6df24982-803d-421b-ade7-4ad3a82b1df9 tempest-GroupsTest-904969559 None] Group tempest-Group1-194457799: created successfully
Apr 29 09:07:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6df24982-803d-421b-ade7-4ad3a82b1df9 tempest-GroupsTest-904969559 None] Create group completed successfully.
Apr 29 09:07:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2e0474d8-3d78-4cf9-b8e6-c54b88b8d32a tempest-GroupsTest-904969559 None] Group tempest-Group2-1586516945: creating
Apr 29 09:07:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2e0474d8-3d78-4cf9-b8e6-c54b88b8d32a tempest-GroupsTest-904969559 None] Group tempest-Group2-1586516945: created successfully
Apr 29 09:07:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2e0474d8-3d78-4cf9-b8e6-c54b88b8d32a tempest-GroupsTest-904969559 None] Create group completed successfully.
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Flow 'volume_create_manager' (43ab9524-45bb-4efd-b943-eb76386279e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7555f1-3d8e-4c09-b8ce-6ae129f92fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7555f1-3d8e-4c09-b8ce-6ae129f92fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1149120910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=79dc5d69-ed2b-4d3a-ae80-b60afd41d9c4,host='devstack@QuobyteHD#QuobyteHD',id=0021b1da-a942-4428-8391-6304883b0794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31969380ef384dcf8cfe3d7cbdf81881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:32Z,use_quota=True,user_id='5bc70a61c7a64552adb106843d93b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e342477-ef1f-49e8-9f3b-197fcbb5ffe7),volume_type_id=7e342477-ef1f-49e8-9f3b-197fcbb5ffe7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009d4e2f-dc75-4eab-b02d-2cf8efd570c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009d4e2f-dc75-4eab-b02d-2cf8efd570c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e8aa96-6288-481e-a6b0-d7dee51422e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e8aa96-6288-481e-a6b0-d7dee51422e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0021b1da-a942-4428-8391-6304883b0794', 'volume_name': 'volume-0021b1da-a942-4428-8391-6304883b0794', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c325c46-8a8c-48c6-a92e-137420da253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c325c46-8a8c-48c6-a92e-137420da253e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9674195-edde-4bfc-b62d-a733c4e7b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:31 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Volume 0021b1da-a942-4428-8391-6304883b0794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0021b1da-a942-4428-8391-6304883b0794', 'volume_size': 1}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=79dc5d69-ed2b-4d3a-ae80-b60afd41d9c4,created_at=2026-04-29T07:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1149120910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=79dc5d69-ed2b-4d3a-ae80-b60afd41d9c4,host='devstack@QuobyteHD#QuobyteHD',id=0021b1da-a942-4428-8391-6304883b0794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31969380ef384dcf8cfe3d7cbdf81881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:32Z,use_quota=True,user_id='5bc70a61c7a64552adb106843d93b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e342477-ef1f-49e8-9f3b-197fcbb5ffe7),volume_type_id=7e342477-ef1f-49e8-9f3b-197fcbb5ffe7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Creating volume 0021b1da-a942-4428-8391-6304883b0794 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:07:31 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:07:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:31 devstack sudo[86200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794 1073741824
Apr 29 09:07:31 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:32 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794 1073741824" returned: 0 in 1.088s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:32 devstack sudo[86206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794
Apr 29 09:07:32 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:33 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794" returned: 0 in 0.715s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:07:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9674195-edde-4bfc-b62d-a733c4e7b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0021b1da-a942-4428-8391-6304883b0794', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e6626d-f56e-4849-ab3e-3b241e4d6743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Volume volume-0021b1da-a942-4428-8391-6304883b0794 (0021b1da-a942-4428-8391-6304883b0794): created successfully
Apr 29 09:07:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e6626d-f56e-4849-ab3e-3b241e4d6743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Flow 'volume_create_manager' (43ab9524-45bb-4efd-b943-eb76386279e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cf4522e0-25df-4a02-876e-640b8518b3c6 tempest-GroupsTest-904969559 None] Created volume successfully.
Apr 29 09:07:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Acquiring lock "cinder-quobyte-0021b1da-a942-4428-8391-6304883b0794" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Lock "cinder-quobyte-0021b1da-a942-4428-8391-6304883b0794" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856e81b-4441-4481-ab21-d493d4a5d569]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:34 devstack sudo[86216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794
Apr 29 09:07:34 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:35 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794" returned: 0 in 0.997s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:35 devstack sudo[86222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794
Apr 29 09:07:35 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:36 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0021b1da-a942-4428-8391-6304883b0794" returned: 0 in 0.788s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Lock "cinder-quobyte-0021b1da-a942-4428-8391-6304883b0794" released by "delete_volume" :: held 1.857s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=46,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Created reservations ['1d44a925-42c5-463d-ab38-6977e02af312'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:36 devstack cinder-volume[83863]: WARNING cinder.quota [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1494120810 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1494120810, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:07:36 devstack cinder-volume[83863]: WARNING cinder.quota [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1494120810 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1494120810, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Created reservations ['9e31662d-050b-40a1-b413-0e51c838bcd1', 'ece82ace-03ad-4bda-8b86-61d603377dc9', '094b5eb4-748f-4c7c-a138-fc718062459a', '1d9346b7-ab51-41c7-8d1a-65cd4e5c1de5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:36 devstack sudo[86225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:07:36 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Created reservations ['a7a3e945-256d-45e6-8f58-d9bb2ac10406'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:37 devstack sudo[86227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:07:37 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:37 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.834s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:37 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:07:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d1f4e4b8-abb2-46e8-bd48-484728b3568f tempest-GroupsTest-904969559 None] Delete group completed successfully.
Apr 29 09:07:38 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.893s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:38 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:07:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2f89b1c2-1066-440c-8a97-61e983080170 tempest-GroupsTest-904969559 None] Delete group completed successfully.
Apr 29 09:07:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9011cd09-71c9-4259-b94c-999cc1fd76fa tempest-GroupsTest-904969559 None] Group tempest-GroupsTest-Group-350126211: creating
Apr 29 09:07:38 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=53,cinder:SELECT=60,cinder:DELETE=3,cinder:INSERT=13 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:07:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9011cd09-71c9-4259-b94c-999cc1fd76fa tempest-GroupsTest-904969559 None] Group tempest-GroupsTest-Group-350126211: created successfully
Apr 29 09:07:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9011cd09-71c9-4259-b94c-999cc1fd76fa tempest-GroupsTest-904969559 None] Create group completed successfully.
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Flow 'volume_create_manager' (7ff23412-2504-446f-b1c1-83462291bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497686b3-8ee7-4e69-a25c-c1a6492a52df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497686b3-8ee7-4e69-a25c-c1a6492a52df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1844418334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c55ee89b-f83a-473f-aee6-bea80fb02632,host='devstack@QuobyteHD#QuobyteHD',id=9f4b4567-287e-4097-8c0b-2efc97d09917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31969380ef384dcf8cfe3d7cbdf81881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:40Z,use_quota=True,user_id='5bc70a61c7a64552adb106843d93b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddff7ecb-ab20-4dcf-addb-bfb12c62a87c),volume_type_id=ddff7ecb-ab20-4dcf-addb-bfb12c62a87c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f46149e-1e46-46b7-ad76-017e479c501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f46149e-1e46-46b7-ad76-017e479c501d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f5c61b-ad19-4c5d-82f2-3a1784f41328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f5c61b-ad19-4c5d-82f2-3a1784f41328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4b4567-287e-4097-8c0b-2efc97d09917', 'volume_name': 'volume-9f4b4567-287e-4097-8c0b-2efc97d09917', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4074d622-a3ed-4da0-accc-127687557e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4074d622-a3ed-4da0-accc-127687557e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ec886d-ce25-43ea-9510-9ba8b0dae35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Volume 9f4b4567-287e-4097-8c0b-2efc97d09917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4b4567-287e-4097-8c0b-2efc97d09917', 'volume_size': 1}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c55ee89b-f83a-473f-aee6-bea80fb02632,created_at=2026-04-29T07:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1844418334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c55ee89b-f83a-473f-aee6-bea80fb02632,host='devstack@QuobyteHD#QuobyteHD',id=9f4b4567-287e-4097-8c0b-2efc97d09917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31969380ef384dcf8cfe3d7cbdf81881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:40Z,use_quota=True,user_id='5bc70a61c7a64552adb106843d93b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddff7ecb-ab20-4dcf-addb-bfb12c62a87c),volume_type_id=ddff7ecb-ab20-4dcf-addb-bfb12c62a87c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Creating volume 9f4b4567-287e-4097-8c0b-2efc97d09917 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:07:40 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:07:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:40 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917 1073741824
Apr 29 09:07:40 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:41 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917 1073741824" returned: 0 in 1.101s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:41 devstack sudo[86246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917
Apr 29 09:07:41 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:42 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917" returned: 0 in 0.702s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:07:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ec886d-ce25-43ea-9510-9ba8b0dae35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4b4567-287e-4097-8c0b-2efc97d09917', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105082c5-e33d-4f28-9b33-f1c077214bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Volume volume-9f4b4567-287e-4097-8c0b-2efc97d09917 (9f4b4567-287e-4097-8c0b-2efc97d09917): created successfully
Apr 29 09:07:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105082c5-e33d-4f28-9b33-f1c077214bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Flow 'volume_create_manager' (7ff23412-2504-446f-b1c1-83462291bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d7990dd2-fec4-4118-860f-322989a86a67 tempest-GroupsTest-904969559 None] Created volume successfully.
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Flow 'volume_create_manager' (5737bd61-6623-45a1-b05c-07a611ac6438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813e5fc3-4944-4816-a25c-a80b5b0f5173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813e5fc3-4944-4816-a25c-a80b5b0f5173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700182665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c55ee89b-f83a-473f-aee6-bea80fb02632,host='devstack@QuobyteHD#QuobyteHD',id=578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31969380ef384dcf8cfe3d7cbdf81881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:43Z,use_quota=True,user_id='5bc70a61c7a64552adb106843d93b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddff7ecb-ab20-4dcf-addb-bfb12c62a87c),volume_type_id=ddff7ecb-ab20-4dcf-addb-bfb12c62a87c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87b1d03-298d-4abf-b4e8-adf8364cb169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87b1d03-298d-4abf-b4e8-adf8364cb169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7ed224-6bc7-441f-a18c-7b25f25b9687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7ed224-6bc7-441f-a18c-7b25f25b9687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e', 'volume_name': 'volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90c8562-a47a-4ea3-9613-1130f2c7a2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90c8562-a47a-4ea3-9613-1130f2c7a2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4030ab42-1516-4495-b48d-bba0d727b073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:43 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Volume 578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e', 'volume_size': 1}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c55ee89b-f83a-473f-aee6-bea80fb02632,created_at=2026-04-29T07:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700182665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c55ee89b-f83a-473f-aee6-bea80fb02632,host='devstack@QuobyteHD#QuobyteHD',id=578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31969380ef384dcf8cfe3d7cbdf81881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:43Z,use_quota=True,user_id='5bc70a61c7a64552adb106843d93b92c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddff7ecb-ab20-4dcf-addb-bfb12c62a87c),volume_type_id=ddff7ecb-ab20-4dcf-addb-bfb12c62a87c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Creating volume 578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:07:43 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:07:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:43 devstack sudo[86250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e 1073741824
Apr 29 09:07:43 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Flow 'volume_create_manager' (6aaad67f-053e-443e-b614-bb60ae590fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6270fce-80a9-49cd-9573-381d033a5cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6270fce-80a9-49cd-9573-381d033a5cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:07:44Z,deleted=False,deleted_at=None,display_description='',display_name='97fef421-42fe-43b7-9302-43ddc5bce1d4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0f150b-488b-44f4-9f13-f958af192dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce9391e42c4380888c070abac9f81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:45Z,use_quota=True,user_id='7e85831f90504eb9a19e3e535d9b4f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24a5fc8-c97e-4a96-9c2c-c16d832c5a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24a5fc8-c97e-4a96-9c2c-c16d832c5a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84814af-3e20-449b-b658-fba26769ae76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84814af-3e20-449b-b658-fba26769ae76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0f150b-488b-44f4-9f13-f958af192dc9', 'volume_name': 'volume-9c0f150b-488b-44f4-9f13-f958af192dc9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849a1cd-7750-47a0-8033-b022589f43b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849a1cd-7750-47a0-8033-b022589f43b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dca18c-b42e-475c-b58d-9baccf653941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:44 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Volume 9c0f150b-488b-44f4-9f13-f958af192dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0f150b-488b-44f4-9f13-f958af192dc9', 'volume_size': 1}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:44 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e 1073741824" returned: 0 in 1.190s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:44 devstack sudo[86256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e
Apr 29 09:07:44 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:45 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.828s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:07:44Z,deleted=False,deleted_at=None,display_description='',display_name='97fef421-42fe-43b7-9302-43ddc5bce1d4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0f150b-488b-44f4-9f13-f958af192dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce9391e42c4380888c070abac9f81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:07:45Z,use_quota=True,user_id='7e85831f90504eb9a19e3e535d9b4f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Creating volume 9c0f150b-488b-44f4-9f13-f958af192dc9 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:07:45 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4030ab42-1516-4495-b48d-bba0d727b073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c577b91-c5ef-4688-bb1b-b0324e3da132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:45 devstack sudo[86259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9 1073741824
Apr 29 09:07:45 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Volume volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e (578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e): created successfully
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c577b91-c5ef-4688-bb1b-b0324e3da132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Flow 'volume_create_manager' (5737bd61-6623-45a1-b05c-07a611ac6438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4dc941dc-38b7-4c1c-9635-b2ddeefab4f1 tempest-GroupsTest-904969559 None] Created volume successfully.
Apr 29 09:07:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-746f3241-26fa-43dc-82c7-1d583ba20c23 tempest-GroupsTest-904969559 None] Update group completed successfully.
Apr 29 09:07:46 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9 1073741824" returned: 0 in 0.970s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:46 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9
Apr 29 09:07:46 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:47 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9" returned: 0 in 0.853s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:07:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dca18c-b42e-475c-b58d-9baccf653941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0f150b-488b-44f4-9f13-f958af192dc9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23501dea-99c9-4d38-959c-114bd5504e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:07:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Volume volume-9c0f150b-488b-44f4-9f13-f958af192dc9 (9c0f150b-488b-44f4-9f13-f958af192dc9): created successfully
Apr 29 09:07:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23501dea-99c9-4d38-959c-114bd5504e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:07:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Flow 'volume_create_manager' (6aaad67f-053e-443e-b614-bb60ae590fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:07:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-2127c8e1-b85e-4752-be80-e8606d765ce6 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Created volume successfully.
Apr 29 09:07:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b20b7c0d-1e23-464a-93aa-50c5c832e1cb tempest-GroupsTest-904969559 None] Update group completed successfully.
Apr 29 09:07:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Acquiring lock "cinder-quobyte-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Lock "cinder-quobyte-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c76e32b-9abe-42c2-b3e1-b75efc91cbad]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:49 devstack sudo[86287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e
Apr 29 09:07:49 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:49 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:50 devstack sudo[86295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e
Apr 29 09:07:50 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:50 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Lock "cinder-quobyte-578a6bdd-b8c1-4f38-8a8a-fae8f817ea8e" released by "delete_volume" :: held 1.536s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Acquiring lock "cinder-quobyte-9f4b4567-287e-4097-8c0b-2efc97d09917" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:07:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Lock "cinder-quobyte-9f4b4567-287e-4097-8c0b-2efc97d09917" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:07:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[118cef5f-0d93-4d85-b56b-d8900e8909cd]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:50 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917
Apr 29 09:07:50 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-20bcbc42-2be8-4743-8979-784dc64fd0ef tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-20bcbc42-2be8-4743-8979-784dc64fd0ef tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2606c23a-9797-43d6-bb94-9bdf1c71a9dd]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:07:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-20bcbc42-2be8-4743-8979-784dc64fd0ef tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:51 devstack sudo[86308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9
Apr 29 09:07:51 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:51 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917" returned: 0 in 0.928s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:51 devstack sudo[86313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917
Apr 29 09:07:51 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:52 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-20bcbc42-2be8-4743-8979-784dc64fd0ef tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-20bcbc42-2be8-4743-8979-784dc64fd0ef tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-20bcbc42-2be8-4743-8979-784dc64fd0ef tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d', 'name': 'volume-9c0f150b-488b-44f4-9f13-f958af192dc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fad42dae-34f6-4cc5-bb35-6493113af72e', 'enforce_multipath': True} {{(pid=83863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 09:07:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-8d9b0271-9a86-443b-ad49-1dab94184213 req-20bcbc42-2be8-4743-8979-784dc64fd0ef tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] attachment_update completed successfully.
Apr 29 09:07:52 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f4b4567-287e-4097-8c0b-2efc97d09917" returned: 0 in 0.687s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Lock "cinder-quobyte-9f4b4567-287e-4097-8c0b-2efc97d09917" released by "delete_volume" :: held 1.673s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Created reservations ['7b95a2b6-d8b2-446e-9a9b-34cc5dfd9ecb'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:52 devstack cinder-volume[83863]: WARNING cinder.quota [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-630690278 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-630690278, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:07:52 devstack cinder-volume[83863]: WARNING cinder.quota [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-630690278 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-630690278, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Created reservations ['35804711-e837-4221-bee3-9c03d01d07c6', 'b418e470-121a-46dd-90c9-57830a2e2b90', 'f52ba68d-4f91-4e31-952e-335f18efdf78', '84a3e6ea-6a29-4e97-8ff2-d41ec40dfa2a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Created reservations ['3190df23-ff7e-402f-8e78-06f3a3f90129', '41c9d64d-d1b3-439d-8a77-818430bcc426', '874298fa-548d-4444-928b-29e33268320b', 'ea5e9463-3942-4ba0-b675-5ca5c796a406'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:53 devstack sudo[86322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:07:53 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:07:53 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root
Apr 29 09:07:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:07:53 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:07:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9587175f-29de-4425-995d-a94d8d21fb6d tempest-GroupsTest-904969559 None] Delete group completed successfully.
Apr 29 09:07:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:07:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:07:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:07:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:07:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:07:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:07:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:07:59 devstack sudo[86826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:07:59 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:00 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.475s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:02 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=43,cinder:INSERT=5,cinder:UPDATE=54 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:08:02 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=30,cinder:INSERT=8,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:08:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e6915454-3d4e-4baf-9a06-ad0d9048966c tempest-GroupsV314Test-1551271120 None] Group tempest-GroupsV314Test-Group-232681410: creating
Apr 29 09:08:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e6915454-3d4e-4baf-9a06-ad0d9048966c tempest-GroupsV314Test-1551271120 None] Group tempest-GroupsV314Test-Group-232681410: created successfully
Apr 29 09:08:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e6915454-3d4e-4baf-9a06-ad0d9048966c tempest-GroupsV314Test-1551271120 None] Create group completed successfully.
Apr 29 09:08:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Flow 'volume_create_manager' (ba42dbd5-3d57-4b19-8375-8bf0a5b101a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3bab32-45ac-4b3d-91c9-2e2f221a945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3bab32-45ac-4b3d-91c9-2e2f221a945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7561065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e498fa3a-1123-43f3-9d26-26c6e65f860a,host='devstack@QuobyteHD#QuobyteHD',id=7a3f7ded-a7fd-4208-a03c-6d6db14ebae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44595633c7ee4a2a8915924c4955f81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:05Z,use_quota=True,user_id='c3d2a61ace1f44ca9f58c704c0ef73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd44d496-8d57-4c3e-a408-ecdb3e26e266),volume_type_id=dd44d496-8d57-4c3e-a408-ecdb3e26e266)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae8b4c3-1972-4a68-ab12-4c63f1027b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae8b4c3-1972-4a68-ab12-4c63f1027b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78218909-b9a1-4f5c-bc34-471264034b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78218909-b9a1-4f5c-bc34-471264034b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3f7ded-a7fd-4208-a03c-6d6db14ebae0', 'volume_name': 'volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55210e2b-417e-44d4-905a-2b539a65789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55210e2b-417e-44d4-905a-2b539a65789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9dee83-ae48-4d9a-80ca-93a56758d2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Volume 7a3f7ded-a7fd-4208-a03c-6d6db14ebae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0', 'volume_size': 1}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e498fa3a-1123-43f3-9d26-26c6e65f860a,created_at=2026-04-29T07:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7561065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e498fa3a-1123-43f3-9d26-26c6e65f860a,host='devstack@QuobyteHD#QuobyteHD',id=7a3f7ded-a7fd-4208-a03c-6d6db14ebae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44595633c7ee4a2a8915924c4955f81c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:05Z,use_quota=True,user_id='c3d2a61ace1f44ca9f58c704c0ef73fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd44d496-8d57-4c3e-a408-ecdb3e26e266),volume_type_id=dd44d496-8d57-4c3e-a408-ecdb3e26e266)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Creating volume 7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:05 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:05 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 1073741824
Apr 29 09:08:05 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:07 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 1073741824" returned: 0 in 2.022s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:07 devstack sudo[86909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0
Apr 29 09:08:07 devstack sudo[86909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:09 devstack sudo[86909]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" returned: 0 in 1.712s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] <== create_volume: return (3866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:08:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.871s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9dee83-ae48-4d9a-80ca-93a56758d2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0037057-105f-4be0-8219-22e4efb3af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:09 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Volume volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 (7a3f7ded-a7fd-4208-a03c-6d6db14ebae0): created successfully
Apr 29 09:08:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0037057-105f-4be0-8219-22e4efb3af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Flow 'volume_create_manager' (ba42dbd5-3d57-4b19-8375-8bf0a5b101a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-57a7f5ac-6959-4bdc-b84f-bc21ec7475c9 tempest-GroupsV314Test-1551271120 None] Created volume successfully.
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (133fca78-313e-4b0e-8f39-18d294005175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4454a603-050f-4fbc-86ba-f669b587526b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4454a603-050f-4fbc-86ba-f669b587526b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1676860631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88596107-a24a-469d-9379-4d75726def8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:11Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abd147d-2e3e-4c07-ab9a-8d9bb3d6ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abd147d-2e3e-4c07-ab9a-8d9bb3d6ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a2cf47-2bbb-4e82-8584-14bc1e2251d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a2cf47-2bbb-4e82-8584-14bc1e2251d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88596107-a24a-469d-9379-4d75726def8d', 'volume_name': 'volume-88596107-a24a-469d-9379-4d75726def8d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0233d777-004b-4997-97e3-410aabbf8d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0233d777-004b-4997-97e3-410aabbf8d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f9c8a6-5be1-4bc5-a57d-327a164989a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Volume 88596107-a24a-469d-9379-4d75726def8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88596107-a24a-469d-9379-4d75726def8d', 'volume_size': 1}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1676860631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88596107-a24a-469d-9379-4d75726def8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:11Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Creating volume 88596107-a24a-469d-9379-4d75726def8d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:11 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:11 devstack sudo[86993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d 1073741824
Apr 29 09:08:11 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:12 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d 1073741824" returned: 0 in 1.352s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:12 devstack sudo[87023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d
Apr 29 09:08:12 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:13 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d" returned: 0 in 0.643s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.108s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Cloning volume 7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 to volume 0533fae8-372a-4cea-8330-a6bcfbed389e
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f9c8a6-5be1-4bc5-a57d-327a164989a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88596107-a24a-469d-9379-4d75726def8d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedd34ba-3172-4a8c-bdb9-3e3abb8a267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Creating offline snapshot 94fa59d5-79d7-4223-8816-07d21a2d7f30 of volume 7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:08:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Volume volume-88596107-a24a-469d-9379-4d75726def8d (88596107-a24a-469d-9379-4d75726def8d): created successfully
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedd34ba-3172-4a8c-bdb9-3e3abb8a267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (133fca78-313e-4b0e-8f39-18d294005175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6275f31-fc9b-4b14-8bda-ef0e05dd4ba4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5a93d69c-cda9-4fa7-acb5-705d5e26bbcf tempest-VolumesActionsTest-640088892 None] Created volume successfully.
Apr 29 09:08:13 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0
Apr 29 09:08:13 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:14 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" returned: 0 in 0.801s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:14 devstack sudo[87032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 1G
Apr 29 09:08:14 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-84b64641-2f13-4060-a024-1743686da0a4 tempest-VolumesActionsTest-640088892 None] Acquiring lock "cinder-88596107-a24a-469d-9379-4d75726def8d" by "attach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-84b64641-2f13-4060-a024-1743686da0a4 tempest-VolumesActionsTest-640088892 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d" acquired by "attach_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-84b64641-2f13-4060-a024-1743686da0a4 tempest-VolumesActionsTest-640088892 None] Attaching volume 88596107-a24a-469d-9379-4d75726def8d to instance 2d636a08-5c6a-4b74-8cb3-b3d2ba39743c at mountpoint /dev/vdb on host None.
Apr 29 09:08:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-84b64641-2f13-4060-a024-1743686da0a4 tempest-VolumesActionsTest-640088892 None] Attach volume completed successfully.
Apr 29 09:08:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-84b64641-2f13-4060-a024-1743686da0a4 tempest-VolumesActionsTest-640088892 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d" released by "attach_volume" :: held 0.138s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:15 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 1G" returned: 0 in 0.993s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:15 devstack sudo[87081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30
Apr 29 09:08:15 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-64816e14-3890-4396-9f3a-1d6a2710ea77 tempest-VolumesActionsTest-1366652606 None] Terminate volume connection completed successfully.
Apr 29 09:08:16 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30" returned: 0 in 1.005s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:16 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:08:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:16 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30
Apr 29 09:08:16 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-64816e14-3890-4396-9f3a-1d6a2710ea77 tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-88596107-a24a-469d-9379-4d75726def8d-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-64816e14-3890-4396-9f3a-1d6a2710ea77 tempest-VolumesActionsTest-1366652606 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-64816e14-3890-4396-9f3a-1d6a2710ea77 tempest-VolumesActionsTest-1366652606 None] Detaching volume 88596107-a24a-469d-9379-4d75726def8d from instance 2d636a08-5c6a-4b74-8cb3-b3d2ba39743c.
Apr 29 09:08:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-64816e14-3890-4396-9f3a-1d6a2710ea77 tempest-VolumesActionsTest-1366652606 None] Detach volume completed successfully.
Apr 29 09:08:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-64816e14-3890-4396-9f3a-1d6a2710ea77 tempest-VolumesActionsTest-1366652606 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d-detach_volume" released by "detach_volume" :: held 0.274s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6db4230-208a-4a30-bf2e-49252e24ffc1 tempest-VolumesActionsTest-640088892 None] Acquiring lock "cinder-88596107-a24a-469d-9379-4d75726def8d-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6db4230-208a-4a30-bf2e-49252e24ffc1 tempest-VolumesActionsTest-640088892 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a6db4230-208a-4a30-bf2e-49252e24ffc1 tempest-VolumesActionsTest-640088892 None] Volume detach called, but volume not attached.
Apr 29 09:08:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6db4230-208a-4a30-bf2e-49252e24ffc1 tempest-VolumesActionsTest-640088892 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:17 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30" returned: 0 in 1.679s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:18 devstack sudo[87186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.info
Apr 29 09:08:18 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Acquiring lock "cinder-88596107-a24a-469d-9379-4d75726def8d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Acquiring lock "cinder-quobyte-88596107-a24a-469d-9379-4d75726def8d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Lock "cinder-quobyte-88596107-a24a-469d-9379-4d75726def8d" acquired by "delete_volume" :: waited 0.059s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2046b9b-4626-4544-afa7-8887c5111584]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:19 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d
Apr 29 09:08:19 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:20 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.info" returned: 0 in 2.139s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:20 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:08:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:20 devstack sudo[87196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.info
Apr 29 09:08:20 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:20 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d" returned: 0 in 1.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:20 devstack sudo[87204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d
Apr 29 09:08:20 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:21 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.info" returned: 0 in 1.602s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Acquiring lock "cinder-quobyte-0533fae8-372a-4cea-8330-a6bcfbed389e" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-0533fae8-372a-4cea-8330-a6bcfbed389e" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] snapshot: 94fa59d5-79d7-4223-8816-07d21a2d7f30, volume: 0533fae8-372a-4cea-8330-a6bcfbed389e,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2b59d2-5a25-4711-a5d6-f15dd8bbbe6f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:22 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88596107-a24a-469d-9379-4d75726def8d" returned: 0 in 1.338s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Lock "cinder-quobyte-88596107-a24a-469d-9379-4d75726def8d" released by "delete_volume" :: held 3.224s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:22 devstack sudo[87248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30
Apr 29 09:08:22 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Created reservations ['49ac5c2c-2403-4d5c-8bb7-6074c59369f2', 'c8e6a716-f87a-4f10-ae9b-eeef2116ec08', 'b761443a-13fd-4e15-a907-45dc376552b2', '1fa5274b-f562-4d75-8355-2cecf8e2287c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:22 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:22 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:23 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30" returned: 0 in 1.971s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:08:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:08:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:08:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e65d02-5e0c-428a-9ab2-3c1325a8325f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:24 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:24 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Deleted volume successfully.
Apr 29 09:08:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aab8afe3-9e50-4509-85bf-0d7c9c58ea37 tempest-VolumesActionsTest-640088892 None] Lock "cinder-88596107-a24a-469d-9379-4d75726def8d-delete_volume" released by "delete_volume" :: held 5.583s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:24 devstack sudo[87270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0
Apr 29 09:08:24 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:25 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" returned: 0 in 1.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:25 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:08:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:25 devstack sudo[87333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e
Apr 29 09:08:25 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:32 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:08:34 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e" returned: 0 in 8.530s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7926c7-ab10-4190-a5b2-4133448ea926]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=3 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:08:34 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0
Apr 29 09:08:34 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (b039cffe-73de-48e2-90c0-9e3bcc18c7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff59685-c8eb-4836-8304-51689d2d2d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff59685-c8eb-4836-8304-51689d2d2d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112283138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d42530b-5167-4860-8b5a-68fa8f5978eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:35Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eba4f9-3e46-4ecd-818f-0bd53441f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eba4f9-3e46-4ecd-818f-0bd53441f70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18ee3c6-4546-496f-9843-e360017be5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f18ee3c6-4546-496f-9843-e360017be5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d42530b-5167-4860-8b5a-68fa8f5978eb', 'volume_name': 'volume-5d42530b-5167-4860-8b5a-68fa8f5978eb', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e4f05f-7877-476f-95fa-e6a0c95a09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e4f05f-7877-476f-95fa-e6a0c95a09de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e533f9c6-597a-4595-b1d8-f62f65f333d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Volume 5d42530b-5167-4860-8b5a-68fa8f5978eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d42530b-5167-4860-8b5a-68fa8f5978eb', 'volume_size': 1}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Flow 'volume_create_manager' (0f8019a9-3859-493f-9c87-0fe77d699b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5ccdbc-fdf4-4660-8732-2847c5f4ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5ccdbc-fdf4-4660-8732-2847c5f4ad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1393121688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d989d8-f1e4-454c-a49c-a58239c0f3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59821f2a2a204444ad285df9a22a0269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:35Z,use_quota=True,user_id='6b9fcbc311df4cb58c36b516227371c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06216bb-736b-4ada-b321-64d4c361c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06216bb-736b-4ada-b321-64d4c361c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8915ff88-e037-49f9-a7e9-2172b45f10dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8915ff88-e037-49f9-a7e9-2172b45f10dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d989d8-f1e4-454c-a49c-a58239c0f3f4', 'volume_name': 'volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4a73fd-fbed-47d7-87eb-9d09cdf57b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4a73fd-fbed-47d7-87eb-9d09cdf57b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06c6c36-ab20-47bc-a327-24bc7cd804b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Volume 39d989d8-f1e4-454c-a49c-a58239c0f3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4', 'volume_size': 1}
Apr 29 09:08:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:35 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" returned: 0 in 1.166s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:35 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:08:35 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Converted 1024.00 MB image at 120.03 MB/s
Apr 29 09:08:35 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:08:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:35 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e
Apr 29 09:08:35 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:36 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e" returned: 0 in 0.602s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-0533fae8-372a-4cea-8330-a6bcfbed389e" released by "_copy_volume_from_snapshot" :: held 14.217s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Acquiring lock "cinder-quobyte-94fa59d5-79d7-4223-8816-07d21a2d7f30" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-94fa59d5-79d7-4223-8816-07d21a2d7f30" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Deleting offline snapshot 94fa59d5-79d7-4223-8816-07d21a2d7f30 of volume 7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] snapshot_file for this snap is: volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9927e02f-5fb2-47f3-8ffc-58cc83a4ccea]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:36 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30
Apr 29 09:08:36 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:36 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30" returned: 0 in 0.710s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea585e-0029-46c6-bf57-d7e4646dc4db]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:36 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0
Apr 29 09:08:36 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:37 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" returned: 0 in 0.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:37 devstack sudo[87490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30
Apr 29 09:08:37 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:38 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30" returned: 0 in 0.682s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:38 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30
Apr 29 09:08:38 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:38 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0.94fa59d5-79d7-4223-8816-07d21a2d7f30" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-94fa59d5-79d7-4223-8816-07d21a2d7f30" released by "_delete_snapshot" :: held 2.790s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.603s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.128s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112283138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d42530b-5167-4860-8b5a-68fa8f5978eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:35Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Creating volume 5d42530b-5167-4860-8b5a-68fa8f5978eb {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:38 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:38 devstack sudo[87499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb 1073741824
Apr 29 09:08:38 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ac1c77cd-00de-4865-8602-1e1fe1b25603 tempest-GroupsV314Test-1551271120 None] Create group from source-group-e498fa3a-1123-43f3-9d26-26c6e65f860a completed successfully.
Apr 29 09:08:39 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb 1073741824" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:39 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb
Apr 29 09:08:39 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Acquiring lock "cinder-quobyte-0533fae8-372a-4cea-8330-a6bcfbed389e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-0533fae8-372a-4cea-8330-a6bcfbed389e" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:40 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb" returned: 0 in 0.727s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.532s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1393121688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d989d8-f1e4-454c-a49c-a58239c0f3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59821f2a2a204444ad285df9a22a0269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:35Z,use_quota=True,user_id='6b9fcbc311df4cb58c36b516227371c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Creating volume 39d989d8-f1e4-454c-a49c-a58239c0f3f4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:40 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a0e554-e82a-40a9-8e9d-786f4d492fb4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:40 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4 1073741824
Apr 29 09:08:40 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e533f9c6-597a-4595-b1d8-f62f65f333d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d42530b-5167-4860-8b5a-68fa8f5978eb', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdda9a1-8cef-441c-8ef7-d699bc174923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Volume volume-5d42530b-5167-4860-8b5a-68fa8f5978eb (5d42530b-5167-4860-8b5a-68fa8f5978eb): created successfully
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdda9a1-8cef-441c-8ef7-d699bc174923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (b039cffe-73de-48e2-90c0-9e3bcc18c7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-57eb98bd-25ca-4f25-9706-635cb49e5cca tempest-VolumesActionsTest-640088892 None] Created volume successfully.
Apr 29 09:08:40 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e
Apr 29 09:08:40 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-5d42530b-5167-4860-8b5a-68fa8f5978eb-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Lock "cinder-5d42530b-5167-4860-8b5a-68fa8f5978eb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-quobyte-5d42530b-5167-4860-8b5a-68fa8f5978eb" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-5d42530b-5167-4860-8b5a-68fa8f5978eb" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:41 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a261c-02f5-4059-b327-4c4789764cd9]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e" returned: 0 in 1.116s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:41 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e
Apr 29 09:08:41 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:41 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb
Apr 29 09:08:41 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:41 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4 1073741824" returned: 0 in 1.407s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:41 devstack sudo[87523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4
Apr 29 09:08:41 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:42 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0533fae8-372a-4cea-8330-a6bcfbed389e" returned: 0 in 0.931s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-0533fae8-372a-4cea-8330-a6bcfbed389e" released by "delete_volume" :: held 2.127s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:42 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb" returned: 0 in 1.008s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:42 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb
Apr 29 09:08:42 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:42 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Created reservations ['627a7ff1-5283-4287-bbf7-32f5cf90be74'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06c6c36-ab20-47bc-a327-24bc7cd804b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5889637d-6052-4cd2-aacb-e349921ae423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Volume volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4 (39d989d8-f1e4-454c-a49c-a58239c0f3f4): created successfully
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5889637d-6052-4cd2-aacb-e349921ae423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Flow 'volume_create_manager' (0f8019a9-3859-493f-9c87-0fe77d699b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2dc0702d-1b49-40b8-9138-e9e50d3d92b4 tempest-ServersNegativeTestJSON-1874696574 None] Created volume successfully.
Apr 29 09:08:42 devstack cinder-volume[83863]: WARNING cinder.quota [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1128786070 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1128786070, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:08:42 devstack cinder-volume[83863]: WARNING cinder.quota [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1128786070 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1128786070, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Created reservations ['c7c2404d-25c9-4a99-b61e-bc31f36ba8f9', 'd3a495d7-2f44-40b0-8728-f594632e2ddd', 'dc973891-1ef4-42d6-b5b3-6e2340f6d513', '31a660cc-0882-4995-bb60-11fa088e2bd1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:42 devstack sudo[87549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:42 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:43 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5d42530b-5167-4860-8b5a-68fa8f5978eb" returned: 0 in 0.790s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-5d42530b-5167-4860-8b5a-68fa8f5978eb" released by "delete_volume" :: held 1.867s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Created reservations ['6d199340-a342-42da-944e-5395ee4dde26', '890ffaf9-2c83-48a3-96ff-f8a9c2f83b6c', 'cf689204-f3a8-4929-90a7-86b421ace474', '0bbfb112-0d49-4f2d-9ca0-589361b353bf'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:43 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:43 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:43 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.664s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:43 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9de36f84-c787-4662-aa96-94a10bff3b5b tempest-GroupsV314Test-1551271120 None] Delete group completed successfully.
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Acquiring lock "cinder-quobyte-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" acquired by "delete_volume" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1f8fd0-17d0-4487-9606-0fe96546d8af]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (e256157f-c4bf-4b4b-991d-1b4a619f1b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f43801f-b8bc-487e-95c9-9344f6d2ec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:44 devstack sudo[87558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0
Apr 29 09:08:44 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f43801f-b8bc-487e-95c9-9344f6d2ec8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1675294566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b7c05d-eca2-4796-b1b0-66a9fa5c356d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:44Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037a8d48-dd75-4ace-a94c-51dd0ca73ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037a8d48-dd75-4ace-a94c-51dd0ca73ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a989727e-b93d-4ced-b952-6347df894bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a989727e-b93d-4ced-b952-6347df894bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b7c05d-eca2-4796-b1b0-66a9fa5c356d', 'volume_name': 'volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03faee5a-4259-4cc3-9bba-d8329a251799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03faee5a-4259-4cc3-9bba-d8329a251799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c729e527-3f24-4f2e-ba40-16a508cd6c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:44 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Volume 05b7c05d-eca2-4796-b1b0-66a9fa5c356d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d', 'volume_size': 1}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1675294566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b7c05d-eca2-4796-b1b0-66a9fa5c356d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:44Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Creating volume 05b7c05d-eca2-4796-b1b0-66a9fa5c356d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:44 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:44 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.926s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Deleted volume successfully.
Apr 29 09:08:44 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d 1073741824
Apr 29 09:08:44 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-27990d27-e93b-408e-a238-18ef15474f0c tempest-VolumesActionsTest-1366652606 None] Lock "cinder-5d42530b-5167-4860-8b5a-68fa8f5978eb-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Flow 'volume_create_manager' (98690e52-e692-482d-9888-9bcf282396b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1713fa5-17cd-4047-8cc3-d2221bb893c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:45 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" returned: 0 in 0.867s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1713fa5-17cd-4047-8cc3-d2221bb893c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-105487104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c32ef6-3207-472e-b3ae-460d2e67e44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59821f2a2a204444ad285df9a22a0269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:45Z,use_quota=True,user_id='6b9fcbc311df4cb58c36b516227371c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:45 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0
Apr 29 09:08:45 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebc81f6-8bef-48ec-b31d-9e10f446a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebc81f6-8bef-48ec-b31d-9e10f446a99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f89d12-e7d5-4c93-b1e2-ed81b85eabe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f89d12-e7d5-4c93-b1e2-ed81b85eabe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c32ef6-3207-472e-b3ae-460d2e67e44e', 'volume_name': 'volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3047314-7992-4862-97ec-eea89f96e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3047314-7992-4862-97ec-eea89f96e593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26b3eab-b45c-4d17-8115-2487fd2d4d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Volume d1c32ef6-3207-472e-b3ae-460d2e67e44e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e', 'volume_size': 1}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:45 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d 1073741824" returned: 0 in 0.931s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:45 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d
Apr 29 09:08:45 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:45 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" returned: 0 in 0.651s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Lock "cinder-quobyte-7a3f7ded-a7fd-4208-a03c-6d6db14ebae0" released by "delete_volume" :: held 1.640s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Created reservations ['65b7f685-fd37-4138-a10d-e2c66614b874'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Created reservations ['c9a39704-e90a-406a-bbee-e480513f9805', 'a1ef14f6-e777-40cf-85a2-b9c3d576663b', 'e8a486b1-37d8-44ad-abfd-8a7b0f6a61dc', '961ee20f-68ea-4c54-9730-4ddb328eeb41'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:46 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-105487104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c32ef6-3207-472e-b3ae-460d2e67e44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59821f2a2a204444ad285df9a22a0269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:45Z,use_quota=True,user_id='6b9fcbc311df4cb58c36b516227371c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Creating volume d1c32ef6-3207-472e-b3ae-460d2e67e44e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:46 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:46 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:46 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:46 devstack sudo[87577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e 1073741824
Apr 29 09:08:46 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c729e527-3f24-4f2e-ba40-16a508cd6c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dc4e48-e433-416d-b99d-af331991c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:46 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Volume volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d (05b7c05d-eca2-4796-b1b0-66a9fa5c356d): created successfully
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dc4e48-e433-416d-b99d-af331991c46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (e256157f-c4bf-4b4b-991d-1b4a619f1b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c244f459-bd13-4e28-88e8-a7e28dcc1a4b tempest-VolumesActionsTest-640088892 None] Created volume successfully.
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-05b7c05d-eca2-4796-b1b0-66a9fa5c356d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Lock "cinder-05b7c05d-eca2-4796-b1b0-66a9fa5c356d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-quobyte-05b7c05d-eca2-4796-b1b0-66a9fa5c356d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-05b7c05d-eca2-4796-b1b0-66a9fa5c356d" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:46 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.770s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-65c0ba1b-81aa-4634-8c07-a98ad1a0335f tempest-GroupsV314Test-1551271120 None] Delete group completed successfully.
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e46c67-adb8-49f9-afeb-acd5ffcfa4f8]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:46 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d
Apr 29 09:08:46 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:47 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e 1073741824" returned: 0 in 1.038s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:47 devstack sudo[87590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e
Apr 29 09:08:47 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:47 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d" returned: 0 in 0.869s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:47 devstack sudo[87595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d
Apr 29 09:08:47 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:47 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26b3eab-b45c-4d17-8115-2487fd2d4d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c77253-9d74-4f4b-8e0d-67ca05e8430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Volume volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e (d1c32ef6-3207-472e-b3ae-460d2e67e44e): created successfully
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c77253-9d74-4f4b-8e0d-67ca05e8430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Flow 'volume_create_manager' (98690e52-e692-482d-9888-9bcf282396b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1c429724-4380-47a5-95b0-e1389d11f6ac tempest-ServersNegativeTestJSON-1874696574 None] Created volume successfully.
Apr 29 09:08:48 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05b7c05d-eca2-4796-b1b0-66a9fa5c356d" returned: 0 in 0.903s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-05b7c05d-eca2-4796-b1b0-66a9fa5c356d" released by "delete_volume" :: held 1.839s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Created reservations ['4ae1c2b7-875b-45b7-9436-0d2810eeea13', '73eca2be-8c70-4b15-8855-3dcbef07c1fe', 'f285c159-b7ac-4aa7-b1cf-55b229db1bb6', '5ac7fff9-e167-4f38-ab5b-7a4add3f972d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:48 devstack sudo[87636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:48 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "cinder-d1c32ef6-3207-472e-b3ae-460d2e67e44e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-d1c32ef6-3207-472e-b3ae-460d2e67e44e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "cinder-quobyte-d1c32ef6-3207-472e-b3ae-460d2e67e44e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-quobyte-d1c32ef6-3207-472e-b3ae-460d2e67e44e" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1f13e7-9ac8-419d-aa5f-fd00a59c261c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:49 devstack sudo[87639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e
Apr 29 09:08:49 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:50 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.146s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Deleted volume successfully.
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fa42014c-dbaa-4710-8d48-c87c30d47d5e tempest-VolumesActionsTest-1366652606 None] Lock "cinder-05b7c05d-eca2-4796-b1b0-66a9fa5c356d-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (700d4134-2926-4d24-a35d-7e45217b877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98480b26-bdf7-49a6-84f2-870b57ee442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98480b26-bdf7-49a6-84f2-870b57ee442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1631556419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2ddef2-fe24-45f4-a118-1f434284c359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:50Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3781e2-5b2b-4545-94ed-2945c937dcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3781e2-5b2b-4545-94ed-2945c937dcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc23e59a-204e-4743-be8a-0c71dc876f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc23e59a-204e-4743-be8a-0c71dc876f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2ddef2-fe24-45f4-a118-1f434284c359', 'volume_name': 'volume-1b2ddef2-fe24-45f4-a118-1f434284c359', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12596cd2-7c19-474d-9889-2c29f96f87fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12596cd2-7c19-474d-9889-2c29f96f87fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f885a6d5-fce3-4ed3-8ba0-2afc9e45ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:50 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Volume 1b2ddef2-fe24-45f4-a118-1f434284c359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2ddef2-fe24-45f4-a118-1f434284c359', 'volume_size': 1}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1631556419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2ddef2-fe24-45f4-a118-1f434284c359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:50Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Creating volume 1b2ddef2-fe24-45f4-a118-1f434284c359 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:50 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:50 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359 1073741824
Apr 29 09:08:50 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:50 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e" returned: 0 in 1.256s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:50 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e
Apr 29 09:08:50 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:51 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1c32ef6-3207-472e-b3ae-460d2e67e44e" returned: 0 in 0.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-quobyte-d1c32ef6-3207-472e-b3ae-460d2e67e44e" released by "delete_volume" :: held 2.166s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:51 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359 1073741824" returned: 0 in 1.325s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Created reservations ['72914132-afc2-48a3-a319-fde21eb2025f', '11454401-d466-42e4-bc79-e84e15838893', '236bdb9c-0a39-4cdf-8266-c76648d00c49', 'f75f220d-a7dd-403f-b642-adb234025ca5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:51 devstack sudo[87655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359
Apr 29 09:08:51 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:51 devstack sudo[87657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:51 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:52 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359" returned: 0 in 0.939s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f885a6d5-fce3-4ed3-8ba0-2afc9e45ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2ddef2-fe24-45f4-a118-1f434284c359', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa87931f-4d88-4dda-83d7-e3d3a41efc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Volume volume-1b2ddef2-fe24-45f4-a118-1f434284c359 (1b2ddef2-fe24-45f4-a118-1f434284c359): created successfully
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa87931f-4d88-4dda-83d7-e3d3a41efc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (700d4134-2926-4d24-a35d-7e45217b877d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a670ad5a-78cc-4c16-9652-96898e9c1fd8 tempest-VolumesActionsTest-640088892 None] Created volume successfully.
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "cinder-39d989d8-f1e4-454c-a49c-a58239c0f3f4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:52 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.027s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Deleted volume successfully.
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-39d989d8-f1e4-454c-a49c-a58239c0f3f4-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eebe603d-0eaf-49f7-9c06-acbbde0dbffe tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-d1c32ef6-3207-472e-b3ae-460d2e67e44e-delete_volume" released by "delete_volume" :: held 3.539s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "cinder-quobyte-39d989d8-f1e4-454c-a49c-a58239c0f3f4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-quobyte-39d989d8-f1e4-454c-a49c-a58239c0f3f4" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca2ad1e-b78e-4ef7-b72d-ecd30a3c24ce]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:53 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4
Apr 29 09:08:53 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-1b2ddef2-fe24-45f4-a118-1f434284c359-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Lock "cinder-1b2ddef2-fe24-45f4-a118-1f434284c359-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-quobyte-1b2ddef2-fe24-45f4-a118-1f434284c359" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-1b2ddef2-fe24-45f4-a118-1f434284c359" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[558fff5f-3c12-4f7e-a026-ab12c2dd8a67]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:53 devstack sudo[87666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359
Apr 29 09:08:53 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:53 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4" returned: 0 in 1.012s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:53 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4
Apr 29 09:08:53 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:54 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-39d989d8-f1e4-454c-a49c-a58239c0f3f4" returned: 0 in 0.638s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-quobyte-39d989d8-f1e4-454c-a49c-a58239c0f3f4" released by "delete_volume" :: held 1.703s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:54 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359" returned: 0 in 0.801s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:54 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359
Apr 29 09:08:54 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Created reservations ['cfbb4c0f-f479-4d91-b420-5ee00fb2aebf', 'f4d052b2-6ab5-4647-8b7c-82a438826ad3', '49bec562-dcbf-4b16-902d-80255588d43b', '2c15fcf2-b7fa-46b4-a4da-8e676d7e3422'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:54 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:54 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:55 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b2ddef2-fe24-45f4-a118-1f434284c359" returned: 0 in 0.915s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-1b2ddef2-fe24-45f4-a118-1f434284c359" released by "delete_volume" :: held 1.777s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Created reservations ['39f0bfa6-2f60-446d-b33e-d22a9c4294f5', 'e891f97d-faab-4db4-93b8-31aabc555f61', '5f3e1386-a4b4-458c-98c5-e049faf0a52f', '920b6244-54d0-4670-8fcf-0592a5818387'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:55 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:55 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:56 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.318s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:56 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:56 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Deleted volume successfully.
Apr 29 09:08:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6a9ac97f-5dd2-4c38-912b-99aca0e42f54 tempest-ServersNegativeTestJSON-1874696574 None] Lock "cinder-39d989d8-f1e4-454c-a49c-a58239c0f3f4-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (a61c15c7-7d54-49e9-87bd-267f2dd27495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ecdc7b-347a-4a94-834d-98c2d9d8090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ecdc7b-347a-4a94-834d-98c2d9d8090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216842438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f7287-75a0-4602-8599-d62202e225d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:57Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9b4f83-336b-4b75-8e8c-199874cffb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9b4f83-336b-4b75-8e8c-199874cffb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef5c0a8-f31b-442d-829c-1da9ce158ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef5c0a8-f31b-442d-829c-1da9ce158ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685f7287-75a0-4602-8599-d62202e225d6', 'volume_name': 'volume-685f7287-75a0-4602-8599-d62202e225d6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c4421b-ccf7-4c61-9e06-be4e031433c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c4421b-ccf7-4c61-9e06-be4e031433c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5932aa8-eb58-4163-825a-8aed2f2004bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:08:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Volume 685f7287-75a0-4602-8599-d62202e225d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685f7287-75a0-4602-8599-d62202e225d6', 'volume_size': 1}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216842438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f7287-75a0-4602-8599-d62202e225d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:08:57Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Creating volume 685f7287-75a0-4602-8599-d62202e225d6 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:08:57 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:57 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6 1073741824
Apr 29 09:08:57 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:57 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.505s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:08:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Deleted volume successfully.
Apr 29 09:08:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ad59767e-d06c-4d4a-a3ff-51892af96cb7 tempest-VolumesActionsTest-1366652606 None] Lock "cinder-1b2ddef2-fe24-45f4-a118-1f434284c359-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:08:58 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Apr 29 09:08:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6 1073741824" returned: 0 in 1.517s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:08:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:58 devstack sudo[87752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6
Apr 29 09:08:58 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:08:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:08:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:08:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:08:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:08:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:08:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:08:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:08:59 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:08:59 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:00 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.943s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:00 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6" returned: 0 in 1.321s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] <== create_volume: return (2952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.965s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5932aa8-eb58-4163-825a-8aed2f2004bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685f7287-75a0-4602-8599-d62202e225d6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe59829-4d9e-424d-8464-1ef83de4adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Volume volume-685f7287-75a0-4602-8599-d62202e225d6 (685f7287-75a0-4602-8599-d62202e225d6): created successfully
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe59829-4d9e-424d-8464-1ef83de4adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (a61c15c7-7d54-49e9-87bd-267f2dd27495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-69045889-9f74-4a4a-a8c4-6d6d3698a03b tempest-VolumesActionsTest-640088892 None] Created volume successfully.
Apr 29 09:09:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-685f7287-75a0-4602-8599-d62202e225d6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Lock "cinder-685f7287-75a0-4602-8599-d62202e225d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Acquiring lock "cinder-quobyte-685f7287-75a0-4602-8599-d62202e225d6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-685f7287-75a0-4602-8599-d62202e225d6" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b20296b-e95e-4064-807c-00ad92e4af1d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:02 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6
Apr 29 09:09:02 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:02 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6" returned: 0 in 0.905s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:02 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6
Apr 29 09:09:02 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:03 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-685f7287-75a0-4602-8599-d62202e225d6" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Lock "cinder-quobyte-685f7287-75a0-4602-8599-d62202e225d6" released by "delete_volume" :: held 1.707s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Created reservations ['169831af-dc57-4025-b15e-ad5ff2844282', '5ab19851-0b85-4c84-bdbb-3c8e4e685340', '2e690607-71c0-4252-ad77-e466f910c72c', '3792c22a-7f5c-4160-acbe-798870084f3f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:03 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:03 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:04 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (2c14bb73-50eb-4a2c-b014-50e9c7f51fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52c5be-ef10-41c6-9e0d-4055c64bb036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.095s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Deleted volume successfully.
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52c5be-ef10-41c6-9e0d-4055c64bb036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1081587065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376ec216-2197-4f94-8c2e-682fe100901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:05Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbe5a38-f392-4067-bc5a-3c4124dd2503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbe5a38-f392-4067-bc5a-3c4124dd2503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcaca84-fb89-44cb-999d-270160d2f4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcaca84-fb89-44cb-999d-270160d2f4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376ec216-2197-4f94-8c2e-682fe100901e', 'volume_name': 'volume-376ec216-2197-4f94-8c2e-682fe100901e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a60856-9887-4cef-8ff7-72efe6ef6cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a60856-9887-4cef-8ff7-72efe6ef6cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58e7fc3-4bcd-4f61-a088-3a224631e842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Volume 376ec216-2197-4f94-8c2e-682fe100901e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376ec216-2197-4f94-8c2e-682fe100901e', 'volume_size': 1}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1081587065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376ec216-2197-4f94-8c2e-682fe100901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700f4e62c0074619875e3ec1c9f0c18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:05Z,use_quota=True,user_id='1ff6609285de46589b398bfc52ff6bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Creating volume 376ec216-2197-4f94-8c2e-682fe100901e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:04 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-200b8f90-8b42-4b8f-9163-1b30045d85cd tempest-VolumesActionsTest-1366652606 None] Lock "cinder-685f7287-75a0-4602-8599-d62202e225d6-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:04 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e 1073741824
Apr 29 09:09:04 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Flow 'volume_create_manager' (85d4451e-3ea9-4be3-baad-bf3dada4c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a868f90-8316-407b-a0ae-95d952483822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a868f90-8316-407b-a0ae-95d952483822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1430669650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ae64ac-8769-475f-a11d-ca39d64cd25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebd09cf47064730819da60b4fc22a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:06Z,use_quota=True,user_id='232ec33c64ea4ce6aca5ff5b30bbc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca249d0-5aae-4ab1-b403-3d47dbddfb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca249d0-5aae-4ab1-b403-3d47dbddfb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfcee3c-6c1f-4d66-857a-601237364ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfcee3c-6c1f-4d66-857a-601237364ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ae64ac-8769-475f-a11d-ca39d64cd25c', 'volume_name': 'volume-07ae64ac-8769-475f-a11d-ca39d64cd25c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce956e8-277f-46bd-a6fd-2fe7042b302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce956e8-277f-46bd-a6fd-2fe7042b302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2646ed80-0403-4d01-8056-5c0d13ac2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Volume 07ae64ac-8769-475f-a11d-ca39d64cd25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ae64ac-8769-475f-a11d-ca39d64cd25c', 'volume_size': 1}
Apr 29 09:09:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:06 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e 1073741824" returned: 0 in 1.156s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:06 devstack sudo[87804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e
Apr 29 09:09:06 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:06 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e" returned: 0 in 0.697s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1430669650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ae64ac-8769-475f-a11d-ca39d64cd25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebd09cf47064730819da60b4fc22a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:06Z,use_quota=True,user_id='232ec33c64ea4ce6aca5ff5b30bbc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Creating volume 07ae64ac-8769-475f-a11d-ca39d64cd25c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:06 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58e7fc3-4bcd-4f61-a088-3a224631e842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376ec216-2197-4f94-8c2e-682fe100901e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:06 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c 1073741824
Apr 29 09:09:06 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5f4001-bee6-4846-9926-217146e68d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:06 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Volume volume-376ec216-2197-4f94-8c2e-682fe100901e (376ec216-2197-4f94-8c2e-682fe100901e): created successfully
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5f4001-bee6-4846-9926-217146e68d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Flow 'volume_create_manager' (2c14bb73-50eb-4a2c-b014-50e9c7f51fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:06 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7793a080-f4c9-4d2f-a57a-3d186309dc7f tempest-VolumesActionsTest-640088892 None] Created volume successfully.
Apr 29 09:09:07 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c 1073741824" returned: 0 in 0.904s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:07 devstack sudo[87814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c
Apr 29 09:09:07 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:08 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c" returned: 0 in 1.006s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2646ed80-0403-4d01-8056-5c0d13ac2825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ae64ac-8769-475f-a11d-ca39d64cd25c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaea74f-43b0-4ab9-a53e-bbb0542d2b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Volume volume-07ae64ac-8769-475f-a11d-ca39d64cd25c (07ae64ac-8769-475f-a11d-ca39d64cd25c): created successfully
Apr 29 09:09:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaea74f-43b0-4ab9-a53e-bbb0542d2b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Flow 'volume_create_manager' (85d4451e-3ea9-4be3-baad-bf3dada4c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-96734503-1d36-411c-abfb-c97f3f6d5541 tempest-VolumeQuotasAdminTestJSON-163182557 None] Created volume successfully.
Apr 29 09:09:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Acquiring lock "cinder-376ec216-2197-4f94-8c2e-682fe100901e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Lock "cinder-376ec216-2197-4f94-8c2e-682fe100901e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Acquiring lock "cinder-quobyte-376ec216-2197-4f94-8c2e-682fe100901e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Lock "cinder-quobyte-376ec216-2197-4f94-8c2e-682fe100901e" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03615ce-185e-4346-a596-5f1e91491433]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:09 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e
Apr 29 09:09:09 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:10 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e" returned: 0 in 0.976s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:10 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e
Apr 29 09:09:10 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Acquiring lock "cinder-07ae64ac-8769-475f-a11d-ca39d64cd25c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "cinder-07ae64ac-8769-475f-a11d-ca39d64cd25c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Acquiring lock "cinder-quobyte-07ae64ac-8769-475f-a11d-ca39d64cd25c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "cinder-quobyte-07ae64ac-8769-475f-a11d-ca39d64cd25c" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ec37ad-a379-4a47-b0b9-aa5c7f3c0c13]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:10 devstack sudo[87824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c
Apr 29 09:09:10 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:11 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-376ec216-2197-4f94-8c2e-682fe100901e" returned: 0 in 0.898s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Lock "cinder-quobyte-376ec216-2197-4f94-8c2e-682fe100901e" released by "delete_volume" :: held 1.938s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Created reservations ['23cbc03a-20de-4060-82fa-af599633be15', '40b7694c-8f23-4bbc-a63d-05432edf9d62', 'b8818dcb-657b-403a-919a-271390274860', '4264dde1-9727-4410-9081-3aa9d298f395'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:11 devstack sudo[87831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:11 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:11 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c" returned: 0 in 1.152s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:11 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c
Apr 29 09:09:11 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:12 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-07ae64ac-8769-475f-a11d-ca39d64cd25c" returned: 0 in 0.798s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "cinder-quobyte-07ae64ac-8769-475f-a11d-ca39d64cd25c" released by "delete_volume" :: held 2.026s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:12 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.110s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Deleted volume successfully.
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cb9e13ae-02f5-4800-b40e-49fe5da6a2ac tempest-VolumesActionsTest-640088892 None] Lock "cinder-376ec216-2197-4f94-8c2e-682fe100901e-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Created reservations ['0cf4afdf-c0a4-42f0-9b8c-3e3bd8c350df', '9ae44250-f38c-45c4-b455-c4826722294d', '6e2ce3ee-a2c4-4af0-9b77-1f8b6ab7e406', 'cdfc4b69-17a5-4917-9b2a-3c13c9072f39'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:12 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:12 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Flow 'volume_create_manager' (264ee4a4-c8e5-44de-9e53-ad7d83b3768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bc86f5-092e-49f5-a203-3f34dd2f4816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bc86f5-092e-49f5-a203-3f34dd2f4816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:13Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390bd1a3-9260-4a64-83ba-3b401dbce847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce9391e42c4380888c070abac9f81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:13Z,use_quota=True,user_id='7e85831f90504eb9a19e3e535d9b4f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6726d-defe-48ec-9428-0d8b60d97968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c6726d-defe-48ec-9428-0d8b60d97968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9e3f21-f7d5-4ed1-8da3-63d5885f9809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.image.glance [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 09:09:13 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.056s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Deleted volume successfully.
Apr 29 09:09:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-40f696dd-146c-4f14-8d25-b4f57082b71b tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "cinder-07ae64ac-8769-475f-a11d-ca39d64cd25c-delete_volume" released by "delete_volume" :: held 3.499s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9e3f21-f7d5-4ed1-8da3-63d5885f9809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '390bd1a3-9260-4a64-83ba-3b401dbce847', 'volume_name': 'volume-390bd1a3-9260-4a64-83ba-3b401dbce847', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491dc2fc50>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5487d11f-110f-4117-bd16-ce2378c1727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5487d11f-110f-4117-bd16-ce2378c1727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f52ecb-06ec-4f8f-afd4-ebb202e704d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Volume 390bd1a3-9260-4a64-83ba-3b401dbce847: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-390bd1a3-9260-4a64-83ba-3b401dbce847', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491dc2fc50>}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Trying to clone 390bd1a3-9260-4a64-83ba-3b401dbce847 from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Flow 'volume_create_manager' (65238d22-a4e7-48f1-932c-755acb908138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c04afe-f071-4dcc-9874-8bcafd8968ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c04afe-f071-4dcc-9874-8bcafd8968ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1301507005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c356fc9-04d2-4c18-9f6e-2208aab36743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebd09cf47064730819da60b4fc22a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:14Z,use_quota=True,user_id='232ec33c64ea4ce6aca5ff5b30bbc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df452fb5-2063-43f5-a681-c56dcda43775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df452fb5-2063-43f5-a681-c56dcda43775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad414c70-2e56-4bde-895b-0bf3ab6de1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad414c70-2e56-4bde-895b-0bf3ab6de1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c356fc9-04d2-4c18-9f6e-2208aab36743', 'volume_name': 'volume-1c356fc9-04d2-4c18-9f6e-2208aab36743', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972804c0-50d2-4319-a073-4a5c9f2eb640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (972804c0-50d2-4319-a073-4a5c9f2eb640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb733e0c-4f17-466b-81fd-d4776324c9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Volume 1c356fc9-04d2-4c18-9f6e-2208aab36743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c356fc9-04d2-4c18-9f6e-2208aab36743', 'volume_size': 1}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1301507005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c356fc9-04d2-4c18-9f6e-2208aab36743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eebd09cf47064730819da60b4fc22a25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:14Z,use_quota=True,user_id='232ec33c64ea4ce6aca5ff5b30bbc6dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Creating volume 1c356fc9-04d2-4c18-9f6e-2208aab36743 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:14 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:14 devstack sudo[87864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743 1073741824
Apr 29 09:09:14 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 09:09:14 devstack cinder-volume[83863]: INFO cinder.image.image_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92312da-c4d0-4e5a-8957-0a75f3801f98]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:15 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD
Apr 29 09:09:15 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:15 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD" returned: 0 in 0.899s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:15 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f is fetched for user 7e85831f90504eb9a19e3e535d9b4f23. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 09:09:15 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e58687-2011-459e-91dd-58466b09e259]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743 1073741824" returned: 0 in 1.300s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:16 devstack sudo[87875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743
Apr 29 09:09:16 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:16 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD
Apr 29 09:09:16 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:17 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD" returned: 0 in 1.435s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:17 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743" returned: 0 in 1.414s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] <== create_volume: return (2785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.788s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.064s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:13Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390bd1a3-9260-4a64-83ba-3b401dbce847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ce9391e42c4380888c070abac9f81a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:13Z,use_quota=True,user_id='7e85831f90504eb9a19e3e535d9b4f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Creating volume 390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:17 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb733e0c-4f17-466b-81fd-d4776324c9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c356fc9-04d2-4c18-9f6e-2208aab36743', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019512ed-9253-4de9-b019-a7bbeeab1eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:17 devstack sudo[87918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 1073741824
Apr 29 09:09:17 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Volume volume-1c356fc9-04d2-4c18-9f6e-2208aab36743 (1c356fc9-04d2-4c18-9f6e-2208aab36743): created successfully
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019512ed-9253-4de9-b019-a7bbeeab1eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Flow 'volume_create_manager' (65238d22-a4e7-48f1-932c-755acb908138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-352cbe25-aeb7-4123-8b2a-4e8097776082 tempest-VolumeQuotasAdminTestJSON-163182557 None] Created volume successfully.
Apr 29 09:09:18 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 1073741824" returned: 0 in 1.329s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:18 devstack sudo[87926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:09:18 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3195064a-0198-4018-80cc-578083c667a7 tempest-VolumeQuotasAdminTestJSON-1481910380 None] Transfer volume completed successfully.
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Flow 'volume_create_manager' (d1108276-b171-4cfe-86d5-8d8791a1857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3037f443-1f9b-457a-939a-3bf2c4f4187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:19 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3037f443-1f9b-457a-939a-3bf2c4f4187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-542540082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55996b03-15af-4f02-b659-e502f8e080e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a1b7a52bde4bfcaf8495c4d53d2bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:20Z,use_quota=True,user_id='b1a2eba3c3c84a66a55690b5dad0ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afad6d8a-70df-4f87-9927-ba55c0e3b9f2),volume_type_id=afad6d8a-70df-4f87-9927-ba55c0e3b9f2)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e1eaa7-c3fa-453c-ba2d-a8c7cd14878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e1eaa7-c3fa-453c-ba2d-a8c7cd14878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf76115-631e-4ac0-a85e-8f50b890bd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf76115-631e-4ac0-a85e-8f50b890bd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55996b03-15af-4f02-b659-e502f8e080e1', 'volume_name': 'volume-55996b03-15af-4f02-b659-e502f8e080e1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751f6e18-d7b0-4c0b-961d-2dfab7715178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751f6e18-d7b0-4c0b-961d-2dfab7715178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58db495b-48d3-4847-92b6-ff5fcf5ee2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Volume 55996b03-15af-4f02-b659-e502f8e080e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55996b03-15af-4f02-b659-e502f8e080e1', 'volume_size': 1}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 0 in 0.865s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] <== create_volume: return (2258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-542540082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55996b03-15af-4f02-b659-e502f8e080e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2a1b7a52bde4bfcaf8495c4d53d2bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:20Z,use_quota=True,user_id='b1a2eba3c3c84a66a55690b5dad0ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afad6d8a-70df-4f87-9927-ba55c0e3b9f2),volume_type_id=afad6d8a-70df-4f87-9927-ba55c0e3b9f2)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Creating volume 55996b03-15af-4f02-b659-e502f8e080e1 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:19 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:19 devstack sudo[87929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1 1073741824
Apr 29 09:09:19 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Attempting download of c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume 390bd1a3-9260-4a64-83ba-3b401dbce847. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60995d8b-c7cd-460c-811b-96242118ecb8]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_xvn5zz72 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:20 devstack sudo[87931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_xvn5zz72
Apr 29 09:09:20 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Acquiring lock "cinder-1c356fc9-04d2-4c18-9f6e-2208aab36743-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Lock "cinder-1c356fc9-04d2-4c18-9f6e-2208aab36743-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Acquiring lock "cinder-quobyte-1c356fc9-04d2-4c18-9f6e-2208aab36743" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Lock "cinder-quobyte-1c356fc9-04d2-4c18-9f6e-2208aab36743" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[561f5335-1140-4f20-969c-7ba2cd4e73cc]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:20 devstack sudo[87936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743
Apr 29 09:09:20 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:20 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1 1073741824" returned: 0 in 1.085s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:20 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_xvn5zz72" returned: 0 in 0.950s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_xvn5zz72 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:20 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1
Apr 29 09:09:20 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:20 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_xvn5zz72
Apr 29 09:09:20 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:21 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743" returned: 0 in 0.812s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:21 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743
Apr 29 09:09:21 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:21 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1" returned: 0 in 0.760s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:21 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58db495b-48d3-4847-92b6-ff5fcf5ee2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55996b03-15af-4f02-b659-e502f8e080e1', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c1c13f-56cf-4b3f-abbb-9510945e7092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_xvn5zz72" returned: 1 in 0.870s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_xvn5zz72' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb0e4c9-c24b-418a-8178-d6a5121cf1ec]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Volume volume-55996b03-15af-4f02-b659-e502f8e080e1 (55996b03-15af-4f02-b659-e502f8e080e1): created successfully
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c1c13f-56cf-4b3f-abbb-9510945e7092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Flow 'volume_create_manager' (d1108276-b171-4cfe-86d5-8d8791a1857c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-abba492e-08af-4da0-bfd1-15e8d4cb87d7 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Created volume successfully.
Apr 29 09:09:21 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD
Apr 29 09:09:21 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:22 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1c356fc9-04d2-4c18-9f6e-2208aab36743" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Lock "cinder-quobyte-1c356fc9-04d2-4c18-9f6e-2208aab36743" released by "delete_volume" :: held 1.570s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Created reservations ['91953615-f7e4-4033-acdf-9377cd1bf417', '4ece7ae3-56d4-4e8e-a76c-77d55850846b', 'f2b38b91-85ad-499c-812a-27d2cc300425', '754e8b6b-edd0-4875-8d92-01fb70cbcb1f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:22 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:22 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:22 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD" returned: 0 in 0.848s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 09:09:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:22 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:09:22 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:23 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.865s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Deleted volume successfully.
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5982d52f-76f1-4dab-8630-20d8af024f0d tempest-VolumeQuotasAdminTestJSON-1171575086 None] Lock "cinder-1c356fc9-04d2-4c18-9f6e-2208aab36743-delete_volume" released by "delete_volume" :: held 2.684s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:23 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:23 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:24 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.741s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:24 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-122555f2-e72e-49aa-ad22-08a6093dbbde tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Retype volume completed successfully.
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Acquiring lock "cinder-55996b03-15af-4f02-b659-e502f8e080e1-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "cinder-55996b03-15af-4f02-b659-e502f8e080e1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Acquiring lock "cinder-quobyte-55996b03-15af-4f02-b659-e502f8e080e1" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "cinder-quobyte-55996b03-15af-4f02-b659-e502f8e080e1" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd220508-9121-4fa1-bbd2-15daddf3f333]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:25 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1
Apr 29 09:09:25 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:25 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 0 in 3.115s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_b0vsatlidevstack@QuobyteHD, size 112.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:09:25 devstack cinder-volume[83863]: INFO cinder.image.image_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Converted 112.00 MB image at 35.90 MB/s
Apr 29 09:09:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:25 devstack sudo[87999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 1G
Apr 29 09:09:25 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:26 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1" returned: 0 in 1.073s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:26 devstack sudo[88007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1
Apr 29 09:09:26 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:26 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 1G" returned: 0 in 0.889s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ebc53d-c65b-4a02-9b90-00fa7ccc9de3]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:26 devstack sudo[88010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:09:26 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:27 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-55996b03-15af-4f02-b659-e502f8e080e1" returned: 0 in 0.706s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "cinder-quobyte-55996b03-15af-4f02-b659-e502f8e080e1" released by "delete_volume" :: held 1.855s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:27 devstack cinder-volume[83863]: WARNING cinder.quota [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:09:27 devstack cinder-volume[83863]: WARNING cinder.quota [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Created reservations ['d306a6ea-51a7-403f-bfa5-c81ae30f54d4', '64bb4c0e-fee8-4659-b7fb-49188cdf03fb', 'a14d170c-5bd0-4b66-a3dd-ef492e85b75c', 'ee9768cf-b3f9-4b11-825a-248d10281f57'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:27 devstack sudo[88013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:27 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:27 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 0 in 1.203s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:27 devstack sudo[88017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:09:27 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:28 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.036s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Deleted volume successfully.
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-53571534-ebbe-4873-b85a-54899e2aeed0 tempest-VolumeRetypeWithoutMigrationTest-1161274026 None] Lock "cinder-55996b03-15af-4f02-b659-e502f8e080e1-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:28 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 1 in 0.933s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Downloaded image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume 390bd1a3-9260-4a64-83ba-3b401dbce847 successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f for user 7e85831f90504eb9a19e3e535d9b4f23 is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Marking volume 390bd1a3-9260-4a64-83ba-3b401dbce847 as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Copying metadata from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f to 390bd1a3-9260-4a64-83ba-3b401dbce847. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Creating volume glance metadata for volume 390bd1a3-9260-4a64-83ba-3b401dbce847 backed by image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f52ecb-06ec-4f8f-afd4-ebb202e704d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390bd1a3-9260-4a64-83ba-3b401dbce847', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491dc2fc50>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e95d288-5f38-46fa-b80f-ad2288b7d9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:28 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Volume volume-390bd1a3-9260-4a64-83ba-3b401dbce847 (390bd1a3-9260-4a64-83ba-3b401dbce847): created successfully
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e95d288-5f38-46fa-b80f-ad2288b7d9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Flow 'volume_create_manager' (264ee4a4-c8e5-44de-9e53-ad7d83b3768a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-f53d83ce-3cc6-4e50-a9b4-6bc8e5375a69 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Created volume successfully.
Apr 29 09:09:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc17c29-1a3b-4ded-b307-8f7893eb3f63]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:32 devstack sudo[88031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:09:32 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:33 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 0 in 0.843s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:33 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:09:33 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:34 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 1 in 0.822s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:09:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.728s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:34 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=121,cinder:UPDATE=145,cinder:DELETE=11,cinder:INSERT=41 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:09:34 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=97,cinder:UPDATE=142,cinder:INSERT=33,cinder:DELETE=10 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:09:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d', 'name': 'volume-390bd1a3-9260-4a64-83ba-3b401dbce847', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '977532d4-929d-4e19-9906-7dc5f6d06682', 'enforce_multipath': True} {{(pid=83863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 29 09:09:34 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-bba2a42b-7e33-4da3-956a-b3da4943623b req-429d78f2-a84b-4d5e-aa93-7eb7e5c58f28 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] attachment_update completed successfully.
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Flow 'volume_create_manager' (10d2b87f-d399-4de8-a81d-62a914144bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3daeee9-c855-410b-a105-0c61ff7ec7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3daeee9-c855-410b-a105-0c61ff7ec7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-788538682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f31fb14-55b6-4279-afa8-c6f0b9749e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068bfb9f7c504b61970e604e0ddb1e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:35Z,use_quota=True,user_id='2dbbab00c952462da1d7e2973b8b3526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259c077e-c0a0-4090-a324-fd20dc6bbfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (259c077e-c0a0-4090-a324-fd20dc6bbfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4205b27a-f79e-4509-9750-d8b9c4df9ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.image.glance [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4205b27a-f79e-4509-9750-d8b9c4df9ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f31fb14-55b6-4279-afa8-c6f0b9749e8e', 'volume_name': 'volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491dc2e510>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb45031-6e2d-4705-a15f-efd0374b716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb45031-6e2d-4705-a15f-efd0374b716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538811a1-b379-462b-badb-921fddfbc316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Volume 7f31fb14-55b6-4279-afa8-c6f0b9749e8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491dc2e510>}
Apr 29 09:09:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Trying to clone 7f31fb14-55b6-4279-afa8-c6f0b9749e8e from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Flow 'volume_create_manager' (abcc4c75-cdbb-4d22-a081-f0120f3fc9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b446b6-9950-4733-aa85-b3ba3e583a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b446b6-9950-4733-aa85-b3ba3e583a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-160906884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1deeb6f6-7430-475a-a05a-29a551ce7626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c31e035dafa4b49a8c7f699465122c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:36Z,use_quota=True,user_id='a1b11cf6287049749cce5e336bb20193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e09c959-0c60-45a0-ab0a-4d2b903debec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e09c959-0c60-45a0-ab0a-4d2b903debec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b30c28-fb67-4ef2-b8e2-7c43ee4c0b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b30c28-fb67-4ef2-b8e2-7c43ee4c0b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1deeb6f6-7430-475a-a05a-29a551ce7626', 'volume_name': 'volume-1deeb6f6-7430-475a-a05a-29a551ce7626', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2741afc1-b7cd-47bc-851b-fb605e09e3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2741afc1-b7cd-47bc-851b-fb605e09e3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385cd133-7444-4f5c-b607-e3c0bf6ccd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:36 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Volume 1deeb6f6-7430-475a-a05a-29a551ce7626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1deeb6f6-7430-475a-a05a-29a551ce7626', 'volume_size': 1}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-160906884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1deeb6f6-7430-475a-a05a-29a551ce7626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c31e035dafa4b49a8c7f699465122c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:36Z,use_quota=True,user_id='a1b11cf6287049749cce5e336bb20193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Creating volume 1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:36 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:36 devstack sudo[88042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 1073741824
Apr 29 09:09:36 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 09:09:36 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[683abd32-82fe-47c1-b57b-ba02c5ea9621]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:36 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD
Apr 29 09:09:36 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:37 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 1073741824" returned: 0 in 0.999s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:37 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:37 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f is fetched for user 2dbbab00c952462da1d7e2973b8b3526. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 09:09:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:37 devstack sudo[88053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626
Apr 29 09:09:37 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:37 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae618d-e750-4caf-bef1-8778089b96cf]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:37 devstack sudo[88055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD
Apr 29 09:09:37 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:38 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385cd133-7444-4f5c-b607-e3c0bf6ccd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1deeb6f6-7430-475a-a05a-29a551ce7626', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b975fc1-6909-4cf8-9e33-97ef85a86886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Volume volume-1deeb6f6-7430-475a-a05a-29a551ce7626 (1deeb6f6-7430-475a-a05a-29a551ce7626): created successfully
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b975fc1-6909-4cf8-9e33-97ef85a86886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Flow 'volume_create_manager' (abcc4c75-cdbb-4d22-a081-f0120f3fc9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-42c891d4-93c7-44b1-9d0e-6ce503cf98d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Created volume successfully.
Apr 29 09:09:38 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-788538682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f31fb14-55b6-4279-afa8-c6f0b9749e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068bfb9f7c504b61970e604e0ddb1e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:35Z,use_quota=True,user_id='2dbbab00c952462da1d7e2973b8b3526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Creating volume 7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:38 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:38 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e 1073741824
Apr 29 09:09:38 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:39 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e 1073741824" returned: 0 in 0.817s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:39 devstack sudo[88071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e
Apr 29 09:09:39 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Flow 'volume_create_manager' (e1662061-2899-446e-89bb-ea88fed887a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61ec421-4e3f-4f8e-a9b3-260e248f1acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61ec421-4e3f-4f8e-a9b3-260e248f1acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1292032617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4233ec7d-b376-45bb-b5c8-aa2c933a9db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f05889c4ac37488cbefabef2a7091446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:39Z,use_quota=True,user_id='fb6d48c10d864ebfb78bd811258689af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004af6d4-da85-4459-b301-75e7e5c3de67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004af6d4-da85-4459-b301-75e7e5c3de67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a5abcd-601d-4ed2-87da-5e3d91723674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a5abcd-601d-4ed2-87da-5e3d91723674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4233ec7d-b376-45bb-b5c8-aa2c933a9db3', 'volume_name': 'volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d14bcf8-e994-4a81-b723-8489c7107002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d14bcf8-e994-4a81-b723-8489c7107002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2560cf61-0159-40c2-8b7f-1465576e4b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Volume 4233ec7d-b376-45bb-b5c8-aa2c933a9db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3', 'volume_size': 1}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:39 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" returned: 0 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.166s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Creating offline snapshot 0e87054d-0133-40ef-b451-9ce0c2d3338d of volume 1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Attempting download of c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume 7f31fb14-55b6-4279-afa8-c6f0b9749e8e. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d347a897-311c-45e1-8e7d-882dbd29cf5c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[232d0579-9590-453b-90f5-99b450683d43]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_zz939o36 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:39 devstack sudo[88093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626
Apr 29 09:09:39 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:39 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_zz939o36
Apr 29 09:09:39 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:40 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_zz939o36" returned: 0 in 0.969s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_zz939o36 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:40 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626" returned: 0 in 1.072s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:40 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d 1G
Apr 29 09:09:40 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:40 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_zz939o36
Apr 29 09:09:40 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:41 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_zz939o36" returned: 1 in 0.737s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_zz939o36' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:09:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff97363-b889-491c-b93a-25c1f8053e34]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:41 devstack sudo[88132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD
Apr 29 09:09:41 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:41 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d 1G" returned: 0 in 0.909s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1deeb6f6-7430-475a-a05a-29a551ce7626 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:41 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1deeb6f6-7430-475a-a05a-29a551ce7626 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d
Apr 29 09:09:41 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:42 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:42 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 09:09:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:42 devstack sudo[88140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e
Apr 29 09:09:42 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:42 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1deeb6f6-7430-475a-a05a-29a551ce7626 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d" returned: 0 in 0.839s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:42 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d is being set with open permissions: ugo+rw
Apr 29 09:09:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:42 devstack sudo[88144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d
Apr 29 09:09:42 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:43 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d" returned: 0 in 0.680s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:43 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.info
Apr 29 09:09:43 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:44 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.info" returned: 0 in 0.930s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:44 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.info is being set with open permissions: ugo+rw
Apr 29 09:09:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:44 devstack sudo[88164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.info
Apr 29 09:09:44 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:44 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" returned: 0 in 2.361s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:44 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a0ybgh0hdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:09:44 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Converted 112.00 MB image at 47.41 MB/s
Apr 29 09:09:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:44 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e 1G
Apr 29 09:09:44 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:45 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.info" returned: 0 in 0.826s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.371s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.613s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1292032617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4233ec7d-b376-45bb-b5c8-aa2c933a9db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f05889c4ac37488cbefabef2a7091446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:09:39Z,use_quota=True,user_id='fb6d48c10d864ebfb78bd811258689af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Creating volume 4233ec7d-b376-45bb-b5c8-aa2c933a9db3 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:09:45 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:45 devstack sudo[88169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3 1073741824
Apr 29 09:09:45 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-67f1d8d7-7826-4791-bbc5-6fe0ad88d21a tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Create snapshot completed successfully
Apr 29 09:09:45 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e 1G" returned: 0 in 0.781s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c723b7-defb-441a-ba92-8bee9bf6d551]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:45 devstack sudo[88174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e
Apr 29 09:09:45 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:46 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3 1073741824" returned: 0 in 1.185s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:46 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3
Apr 29 09:09:46 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "cinder-0e87054d-0133-40ef-b451-9ce0c2d3338d-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-0e87054d-0133-40ef-b451-9ce0c2d3338d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "cinder-quobyte-1deeb6f6-7430-475a-a05a-29a551ce7626" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-quobyte-1deeb6f6-7430-475a-a05a-29a551ce7626" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "cinder-quobyte-0e87054d-0133-40ef-b451-9ce0c2d3338d" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-quobyte-0e87054d-0133-40ef-b451-9ce0c2d3338d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:46 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Deleting offline snapshot 0e87054d-0133-40ef-b451-9ce0c2d3338d of volume 1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] snapshot_file for this snap is: volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" returned: 0 in 1.219s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0512e9-fef8-4e91-bb69-67e00098ab13]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:46 devstack sudo[88184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e
Apr 29 09:09:46 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:46 devstack sudo[88185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d
Apr 29 09:09:46 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:47 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3" returned: 0 in 0.775s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2560cf61-0159-40c2-8b7f-1465576e4b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43638ef6-04d6-4209-9ba8-e2cd99ee4b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Volume volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3 (4233ec7d-b376-45bb-b5c8-aa2c933a9db3): created successfully
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43638ef6-04d6-4209-9ba8-e2cd99ee4b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Flow 'volume_create_manager' (e1662061-2899-446e-89bb-ea88fed887a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-33902a79-970e-469e-9143-914fbb5c92c3 tempest-AbsoluteLimitsTests-178999791 None] Created volume successfully.
Apr 29 09:09:47 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" returned: 1 in 0.857s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Downloaded image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume 7f31fb14-55b6-4279-afa8-c6f0b9749e8e successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f for user 2dbbab00c952462da1d7e2973b8b3526 is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Marking volume 7f31fb14-55b6-4279-afa8-c6f0b9749e8e as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Copying metadata from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f to 7f31fb14-55b6-4279-afa8-c6f0b9749e8e. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Creating volume glance metadata for volume 7f31fb14-55b6-4279-afa8-c6f0b9749e8e backed by image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 09:09:47 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d" returned: 0 in 0.901s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1deeb6f6-7430-475a-a05a-29a551ce7626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8209ee3-e8ab-40f0-bdcb-8cb3f9ef4c2d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538811a1-b379-462b-badb-921fddfbc316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491dc2e510>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ab0a15-9589-46c6-a48a-66afbd5a271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:09:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Volume volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e (7f31fb14-55b6-4279-afa8-c6f0b9749e8e): created successfully
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ab0a15-9589-46c6-a48a-66afbd5a271a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:09:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Flow 'volume_create_manager' (10d2b87f-d399-4de8-a81d-62a914144bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:09:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3e4a3b86-7159-4116-aa13-0087c39619e9 tempest-VolumesImageMetadata-741690977 None] Created volume successfully.
Apr 29 09:09:47 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626
Apr 29 09:09:47 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Acquiring lock "cinder-4233ec7d-b376-45bb-b5c8-aa2c933a9db3-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Lock "cinder-4233ec7d-b376-45bb-b5c8-aa2c933a9db3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Acquiring lock "cinder-quobyte-4233ec7d-b376-45bb-b5c8-aa2c933a9db3" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Lock "cinder-quobyte-4233ec7d-b376-45bb-b5c8-aa2c933a9db3" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a481b-2ca7-442f-adb6-1204e273b487]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:48 devstack sudo[88229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3
Apr 29 09:09:48 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:48 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626" returned: 0 in 1.003s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:48 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d
Apr 29 09:09:48 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Acquiring lock "cinder-7f31fb14-55b6-4279-afa8-c6f0b9749e8e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Lock "cinder-7f31fb14-55b6-4279-afa8-c6f0b9749e8e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Acquiring lock "cinder-quobyte-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Lock "cinder-quobyte-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3661e52-92d3-440b-92c0-bf464b5898b2]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:49 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e
Apr 29 09:09:49 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:49 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3" returned: 0 in 0.960s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:49 devstack sudo[88242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3
Apr 29 09:09:49 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:49 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d" returned: 0 in 0.886s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:49 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d
Apr 29 09:09:49 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:50 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" returned: 0 in 0.945s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:50 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e
Apr 29 09:09:50 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:50 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4233ec7d-b376-45bb-b5c8-aa2c933a9db3" returned: 0 in 0.762s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Lock "cinder-quobyte-4233ec7d-b376-45bb-b5c8-aa2c933a9db3" released by "delete_volume" :: held 1.787s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Created reservations ['07340131-14f0-476c-812d-16c49a6a7270', '167c57e2-5760-433e-8a4c-0da6f9566cf4', 'a2989c06-c226-4fee-97cf-65f3c12d244f', 'cca8f030-0621-4735-9461-811016c10d97'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:50 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626.0e87054d-0133-40ef-b451-9ce0c2d3338d" returned: 0 in 0.900s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:50 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:50 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-quobyte-0e87054d-0133-40ef-b451-9ce0c2d3338d" released by "_delete_snapshot" :: held 3.834s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-quobyte-1deeb6f6-7430-475a-a05a-29a551ce7626" released by "delete_snapshot" :: held 3.864s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Created reservations ['74c9d235-76df-4ec7-bef5-30511201ba1c', 'b6e82ed6-8410-4727-9db4-f8224ca1e1b3', '971f9040-0886-4a66-843c-c45f7baabcd5', '0e4975c5-7eb6-4707-a5be-d6639c8ea1a5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Delete snapshot completed successfully.
Apr 29 09:09:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-055a96f1-3236-4c4c-bcf3-5068d0961493 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-0e87054d-0133-40ef-b451-9ce0c2d3338d-delete_snapshot" released by "delete_snapshot" :: held 4.142s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "cinder-1deeb6f6-7430-475a-a05a-29a551ce7626-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-1deeb6f6-7430-475a-a05a-29a551ce7626-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "cinder-quobyte-1deeb6f6-7430-475a-a05a-29a551ce7626" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-quobyte-1deeb6f6-7430-475a-a05a-29a551ce7626" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:09:51 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" returned: 1 in 1.222s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4b21c-7f44-412e-a9ce-66b58849a4cc]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:51 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e
Apr 29 09:09:51 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:51 devstack sudo[88277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626
Apr 29 09:09:51 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:51 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.994s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Deleted volume successfully.
Apr 29 09:09:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-79733a16-c59f-474f-9189-cd278fd6c092 tempest-AbsoluteLimitsTests-178999791 None] Lock "cinder-4233ec7d-b376-45bb-b5c8-aa2c933a9db3-delete_volume" released by "delete_volume" :: held 3.170s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:52 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" returned: 0 in 0.763s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Lock "cinder-quobyte-7f31fb14-55b6-4279-afa8-c6f0b9749e8e" released by "delete_volume" :: held 3.027s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Created reservations ['100897da-b8b0-4c3f-b8ff-a645652655cd', '1440455f-9c06-4394-9987-7c5b020cf03d', 'd962afc9-8c0b-4268-a0fe-3986e0889098', '8474fe30-2f38-4250-b76f-d0fbfb0a273a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:52 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626" returned: 0 in 0.875s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:52 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626
Apr 29 09:09:52 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:52 devstack sudo[88287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:52 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:53 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1deeb6f6-7430-475a-a05a-29a551ce7626" returned: 0 in 0.800s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-quobyte-1deeb6f6-7430-475a-a05a-29a551ce7626" released by "delete_volume" :: held 1.803s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:53 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.845s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Deleted volume successfully.
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Created reservations ['22d8e220-2c47-4593-92a3-dd551c12d18b', '320f89ce-b035-44ce-96ec-9272632b8d8c', '8ac4eea4-af34-4897-b25a-98534b75b625', '0778cb66-2b19-4e21-b272-968f5b04730a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f68df8e5-cf94-4d69-99db-66caedf4bcd4 tempest-VolumesImageMetadata-741690977 None] Lock "cinder-7f31fb14-55b6-4279-afa8-c6f0b9749e8e-delete_volume" released by "delete_volume" :: held 4.173s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:53 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:53 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:09:54 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Apr 29 09:09:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.889s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:09:54 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:09:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Deleted volume successfully.
Apr 29 09:09:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7ccd98cb-3930-448b-b133-6f41e2568187 tempest-VolumeSnapshotQuotasNegativeTestJSON-840709471 None] Lock "cinder-1deeb6f6-7430-475a-a05a-29a551ce7626-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:09:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:09:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:09:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:09:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:09:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:09:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:09:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:09:59 devstack sudo[88336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:09:59 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:00 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.277s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=43,cinder:UPDATE=43,cinder:INSERT=13,cinder:DELETE=2 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Flow 'volume_create_manager' (02918da7-38b0-4f78-aea9-376d123dfb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743f9d70-e40c-4e4b-aaa3-33e4a52148ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743f9d70-e40c-4e4b-aaa3-33e4a52148ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1223015931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4038202-e88c-45b6-8da2-4677306966be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee00df5580484a2094da60e4f75aae46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:03Z,use_quota=True,user_id='5a77aa053e08446e98a99af141c7562e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817c43a7-13ef-498d-b954-be43cbf3b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817c43a7-13ef-498d-b954-be43cbf3b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41a2bea-4835-4f53-a784-b09e98b5e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41a2bea-4835-4f53-a784-b09e98b5e175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4038202-e88c-45b6-8da2-4677306966be', 'volume_name': 'volume-c4038202-e88c-45b6-8da2-4677306966be', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e77d16b-c819-4c94-af41-7247d1878cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e77d16b-c819-4c94-af41-7247d1878cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205ba9ca-0304-40a1-8231-3c65300b84d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Volume c4038202-e88c-45b6-8da2-4677306966be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4038202-e88c-45b6-8da2-4677306966be', 'volume_size': 1}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1223015931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4038202-e88c-45b6-8da2-4677306966be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee00df5580484a2094da60e4f75aae46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:03Z,use_quota=True,user_id='5a77aa053e08446e98a99af141c7562e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Creating volume c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:03 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:03 devstack sudo[88339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be 1073741824
Apr 29 09:10:03 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Flow 'volume_create_manager' (a52bbaef-f75b-463d-9076-8e4875c317cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef73961-b20c-4006-ab04-0c7cbe6a45b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef73961-b20c-4006-ab04-0c7cbe6a45b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2038227267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eb5b71-0515-4921-9ea8-2d009d2dacce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b371f4c3274cf697b57311e954d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:04Z,use_quota=True,user_id='7eb0f9ebc305468e940e0795fa834e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e04d7eee-ecf2-42ea-985a-f484b7d4620c),volume_type_id=e04d7eee-ecf2-42ea-985a-f484b7d4620c)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fec53eb-5fd4-4c30-a870-df8160e90acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fec53eb-5fd4-4c30-a870-df8160e90acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7f5bd3-b214-4b00-82d4-91d646218d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7f5bd3-b214-4b00-82d4-91d646218d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50eb5b71-0515-4921-9ea8-2d009d2dacce', 'volume_name': 'volume-50eb5b71-0515-4921-9ea8-2d009d2dacce', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab8b06d-3469-4894-800f-96e6ad0d2c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab8b06d-3469-4894-800f-96e6ad0d2c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df29d155-ea1b-4667-8c3d-073a736fcca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Volume 50eb5b71-0515-4921-9ea8-2d009d2dacce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50eb5b71-0515-4921-9ea8-2d009d2dacce', 'volume_size': 1}
Apr 29 09:10:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:04 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be 1073741824" returned: 0 in 1.223s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:04 devstack sudo[88412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be
Apr 29 09:10:04 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:05 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be" returned: 0 in 0.782s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2038227267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eb5b71-0515-4921-9ea8-2d009d2dacce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b371f4c3274cf697b57311e954d829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:04Z,use_quota=True,user_id='7eb0f9ebc305468e940e0795fa834e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e04d7eee-ecf2-42ea-985a-f484b7d4620c),volume_type_id=e04d7eee-ecf2-42ea-985a-f484b7d4620c)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Creating volume 50eb5b71-0515-4921-9ea8-2d009d2dacce {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:05 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:05 devstack sudo[88419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce 1073741824
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205ba9ca-0304-40a1-8231-3c65300b84d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4038202-e88c-45b6-8da2-4677306966be', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:05 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7d259e-4867-40da-a0b4-a3837753f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Volume volume-c4038202-e88c-45b6-8da2-4677306966be (c4038202-e88c-45b6-8da2-4677306966be): created successfully
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7d259e-4867-40da-a0b4-a3837753f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Flow 'volume_create_manager' (02918da7-38b0-4f78-aea9-376d123dfb40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6d319fc0-3a3c-4e4d-9bd3-45f604bc163d tempest-VolumesDeleteCascade-460215370 None] Created volume successfully.
Apr 29 09:10:06 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce 1073741824" returned: 0 in 1.334s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:07 devstack sudo[88428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce
Apr 29 09:10:07 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:08 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce" returned: 0 in 1.128s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] <== create_volume: return (2582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.585s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.904s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Creating offline snapshot 30cfec47-e0b7-485b-8d49-b606b185b613 of volume c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df29d155-ea1b-4667-8c3d-073a736fcca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50eb5b71-0515-4921-9ea8-2d009d2dacce', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9181fc32-b944-4df4-8884-0918490c26d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0c021d-6321-49ef-a93b-a5cebe7dc2bb]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Volume volume-50eb5b71-0515-4921-9ea8-2d009d2dacce (50eb5b71-0515-4921-9ea8-2d009d2dacce): created successfully
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9181fc32-b944-4df4-8884-0918490c26d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Flow 'volume_create_manager' (a52bbaef-f75b-463d-9076-8e4875c317cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-febe6e09-a00a-44bc-a18b-9a87fdf7750d tempest-VolumeTypesAccessTest-91086663 None] Created volume successfully.
Apr 29 09:10:08 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be
Apr 29 09:10:08 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:09 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be" returned: 0 in 0.910s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:09 devstack sudo[88469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 1G
Apr 29 09:10:09 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Acquiring lock "cinder-50eb5b71-0515-4921-9ea8-2d009d2dacce-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Lock "cinder-50eb5b71-0515-4921-9ea8-2d009d2dacce-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Acquiring lock "cinder-quobyte-50eb5b71-0515-4921-9ea8-2d009d2dacce" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Lock "cinder-quobyte-50eb5b71-0515-4921-9ea8-2d009d2dacce" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc501d56-2006-4335-8a36-602ff010e694]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:09 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce
Apr 29 09:10:09 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:10 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 1G" returned: 0 in 1.022s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:10 devstack sudo[88477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613
Apr 29 09:10:10 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:10 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce" returned: 0 in 0.880s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:10 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce
Apr 29 09:10:10 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:10 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613" returned: 0 in 0.844s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:10 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 is being set with open permissions: ugo+rw
Apr 29 09:10:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:11 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613
Apr 29 09:10:11 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:11 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-50eb5b71-0515-4921-9ea8-2d009d2dacce" returned: 0 in 0.866s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Lock "cinder-quobyte-50eb5b71-0515-4921-9ea8-2d009d2dacce" released by "delete_volume" :: held 1.803s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:11 devstack cinder-volume[83863]: WARNING cinder.quota [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1733272868 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1733272868, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:10:11 devstack cinder-volume[83863]: WARNING cinder.quota [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1733272868 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1733272868, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Created reservations ['11f32615-83f0-4eed-a023-be320aa0ea9d', '5c077d02-c35f-45ae-bd38-944f205c6765', 'bbc17084-d8a0-4baa-9b39-d3138df099ef', '4c0fcb0c-6e51-45b5-a606-8d7cca8aaf21'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:11 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:10:11 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:11 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613" returned: 0 in 0.911s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:11 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.info
Apr 29 09:10:11 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:12 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Flow 'volume_create_manager' (faaabfc6-53f3-4248-a691-5e55263ec870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db75bfa-0d38-411f-a7f6-2706fca8bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.810s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db75bfa-0d38-411f-a7f6-2706fca8bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1011590788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b53c1c-25c8-4020-8e02-0c8a1076c3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8284ea0cff04820bcbd1ea7122f3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:12Z,use_quota=True,user_id='815fe9a88a2c412ab165a749a9852a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe9dff3-7c0b-444a-93dd-bea028a03e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe9dff3-7c0b-444a-93dd-bea028a03e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16162b9-13ac-4230-989d-bc1f55b38f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16162b9-13ac-4230-989d-bc1f55b38f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b53c1c-25c8-4020-8e02-0c8a1076c3c2', 'volume_name': 'volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45cd09db-d2b9-43e1-aaef-ba1108f6f6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45cd09db-d2b9-43e1-aaef-ba1108f6f6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1adad8-e88a-4670-83ef-dc837442ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Volume 93b53c1c-25c8-4020-8e02-0c8a1076c3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2', 'volume_size': 1}
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Deleted volume successfully.
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8429d3f3-8461-4d84-b812-2451804df518 tempest-VolumeTypesAccessTest-91086663 None] Lock "cinder-50eb5b71-0515-4921-9ea8-2d009d2dacce-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:12 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.info" returned: 0 in 1.035s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:12 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.info is being set with open permissions: ugo+rw
Apr 29 09:10:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:13 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.info
Apr 29 09:10:13 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-f777d24b-8b6b-439c-9525-2b27ab6024ae tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Terminate volume connection completed successfully.
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-f777d24b-8b6b-439c-9525-2b27ab6024ae tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Deleting attachment 977532d4-929d-4e19-9906-7dc5f6d06682. {{(pid=83863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 09:10:13 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.info" returned: 0 in 0.635s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.517s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1011590788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b53c1c-25c8-4020-8e02-0c8a1076c3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8284ea0cff04820bcbd1ea7122f3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:12Z,use_quota=True,user_id='815fe9a88a2c412ab165a749a9852a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Creating volume 93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:13 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 1073741824
Apr 29 09:10:13 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9e510dd0-3313-4b02-817e-dbd048451b54 tempest-VolumesDeleteCascade-460215370 None] Create snapshot completed successfully
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "cinder-390bd1a3-9260-4a64-83ba-3b401dbce847-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-390bd1a3-9260-4a64-83ba-3b401dbce847-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "cinder-quobyte-390bd1a3-9260-4a64-83ba-3b401dbce847" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-quobyte-390bd1a3-9260-4a64-83ba-3b401dbce847" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:14 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fcbc16-d131-437b-845f-daf4d0ad1567]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:14 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:10:14 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:14 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 1073741824" returned: 0 in 1.137s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:14 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:10:14 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:15 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 0 in 1.082s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:15 devstack sudo[88520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:10:15 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:15 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.745s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.829s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Creating offline snapshot 3df9102f-6ed3-41f8-b8fa-e2632a414282 of volume c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1adad8-e88a-4670-83ef-dc837442ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846e9b35-8da2-4d46-a040-8e7c85ef21a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce19dd1-cbe7-49ed-92f4-a3aa498e0789]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:15 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Volume volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 (93b53c1c-25c8-4020-8e02-0c8a1076c3c2): created successfully
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846e9b35-8da2-4d46-a040-8e7c85ef21a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Flow 'volume_create_manager' (faaabfc6-53f3-4248-a691-5e55263ec870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d9dea79a-6b4e-4b06-8714-60db4e0f46ef tempest-VolumesActionsTest-1973512944 None] Created volume successfully.
Apr 29 09:10:15 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613
Apr 29 09:10:15 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:16 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 1 in 0.909s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:16 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847
Apr 29 09:10:16 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:16 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613" returned: 0 in 0.847s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4038202-e88c-45b6-8da2-4677306966be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:16 devstack sudo[88537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 1G
Apr 29 09:10:16 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:16 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-390bd1a3-9260-4a64-83ba-3b401dbce847" returned: 0 in 0.794s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-quobyte-390bd1a3-9260-4a64-83ba-3b401dbce847" released by "delete_volume" :: held 2.890s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:16 devstack cinder-volume[83863]: DEBUG cinder.quota [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Created reservations ['c38fc73e-02ad-4e94-927d-3771ae68474d', 'cb79b414-9a46-4dc4-9441-2904eea01927', '66757ac3-9eca-4a78-aeaf-9b3e5cfbafe2', '253da6ae-27a5-4093-b5bc-a5b495cd9e34'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:17 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:10:17 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:17 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 1G" returned: 0 in 1.200s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:17 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282
Apr 29 09:10:17 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:17 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.863s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:17 devstack cinder-volume[83863]: DEBUG cinder.manager [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:10:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Deleted volume successfully.
Apr 29 09:10:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-326e7f7c-2f45-4bb2-97e5-40e4f96a792a req-fe41b680-5d39-4436-86b4-b6e0e5e64dc4 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-390bd1a3-9260-4a64-83ba-3b401dbce847-delete_volume" released by "delete_volume" :: held 4.133s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:18 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282" returned: 0 in 1.121s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:18 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 is being set with open permissions: ugo+rw
Apr 29 09:10:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:18 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282
Apr 29 09:10:18 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:19 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282" returned: 0 in 0.815s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b4277394-df36-44f9-b62b-fa7e646e9118 tempest-VolumesDeleteCascade-460215370 None] Create snapshot completed successfully
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-c4038202-e88c-45b6-8da2-4677306966be-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-c4038202-e88c-45b6-8da2-4677306966be-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Performing cascade delete. {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-30cfec47-e0b7-485b-8d49-b606b185b613-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-30cfec47-e0b7-485b-8d49-b606b185b613-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-30cfec47-e0b7-485b-8d49-b606b185b613" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-30cfec47-e0b7-485b-8d49-b606b185b613" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Deleting offline snapshot 30cfec47-e0b7-485b-8d49-b606b185b613 of volume c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] snapshot_file for this snap is: volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb58208c-9286-4743-97ab-bc57edb736e7]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:20 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613
Apr 29 09:10:20 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:21 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613" returned: 0 in 0.861s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4038202-e88c-45b6-8da2-4677306966be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:10:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d29f4-e3ce-4c35-bccc-7a87301c8356]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:21 devstack sudo[88635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be
Apr 29 09:10:21 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:22 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be" returned: 0 in 0.847s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d06d6f-ba64-4cc2-8d02-b5eeaa091855]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:22 devstack sudo[88647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282
Apr 29 09:10:22 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:23 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4038202-e88c-45b6-8da2-4677306966be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb22910-aa64-4fd6-9f3b-7e8ccc8936f4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Flow 'volume_create_manager' (0b1d3a84-a4a3-42bc-9d47-7fb48f8c4f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104087f2-e70d-49e0-b313-dc85ea43f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:23 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613
Apr 29 09:10:23 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104087f2-e70d-49e0-b313-dc85ea43f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-939682441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed170f9-999b-4a2f-bcd1-3f3f1e16381e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c646655da7c44eb9ef0b9062a02276f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:23Z,use_quota=True,user_id='60cda734311e422284b5a2b8d0fba51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0080ad4-e3e5-4405-8ffe-49dcea68fcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0080ad4-e3e5-4405-8ffe-49dcea68fcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebf84e8-1903-4e75-84dc-72310a87ae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebf84e8-1903-4e75-84dc-72310a87ae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed170f9-999b-4a2f-bcd1-3f3f1e16381e', 'volume_name': 'volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc367e89-d3e5-4eda-a835-81282336f244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc367e89-d3e5-4eda-a835-81282336f244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e9582d-7350-4ae9-aa74-8680d5cb409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:23 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Volume 4ed170f9-999b-4a2f-bcd1-3f3f1e16381e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e', 'volume_size': 1}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-939682441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed170f9-999b-4a2f-bcd1-3f3f1e16381e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c646655da7c44eb9ef0b9062a02276f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:23Z,use_quota=True,user_id='60cda734311e422284b5a2b8d0fba51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Creating volume 4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:23 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:10:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:23 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e 1073741824
Apr 29 09:10:23 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:24 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613" returned: 0 in 0.921s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4038202-e88c-45b6-8da2-4677306966be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:10:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1263df-df9a-4868-a0f0-1bad6de839f9]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:24 devstack sudo[88671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be
Apr 29 09:10:24 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:24 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e 1073741824" returned: 0 in 0.951s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:24 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e
Apr 29 09:10:24 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:25 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" returned: 0 in 0.772s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e9582d-7350-4ae9-aa74-8680d5cb409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58942dd6-9dfd-4f9a-a956-d341325376ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Volume volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e (4ed170f9-999b-4a2f-bcd1-3f3f1e16381e): created successfully
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58942dd6-9dfd-4f9a-a956-d341325376ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Flow 'volume_create_manager' (0b1d3a84-a4a3-42bc-9d47-7fb48f8c4f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-17c1b289-2587-456f-9004-f2a590ef68df tempest-SnapshotMetadataTestJSON-1442933967 None] Created volume successfully.
Apr 29 09:10:25 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be" returned: 0 in 1.233s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:25 devstack sudo[88679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613
Apr 29 09:10:25 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Creating offline snapshot c8e7ac23-0c69-413f-acb0-022de8da0b47 of volume 4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c25357-6d8e-4687-9343-7ee1ca6573c3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:26 devstack sudo[88682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e
Apr 29 09:10:26 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:26 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613" returned: 0 in 1.081s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:26 devstack sudo[88703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613
Apr 29 09:10:26 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:26 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" returned: 0 in 0.988s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:26 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 1G
Apr 29 09:10:26 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:27 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.30cfec47-e0b7-485b-8d49-b606b185b613" returned: 0 in 0.642s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 -F qcow2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:27 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 -F qcow2
Apr 29 09:10:27 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:27 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 1G" returned: 0 in 0.917s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:27 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47
Apr 29 09:10:27 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:27 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4038202-e88c-45b6-8da2-4677306966be /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 -F qcow2" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-30cfec47-e0b7-485b-8d49-b606b185b613" released by "_delete_snapshot" :: held 7.540s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" released by "delete_snapshot" :: held 7.592s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Created reservations ['c3fb56e9-1294-4354-9371-4562d5324657', 'a30bc3c1-c920-45c0-a050-ad93805c6bef', '6ed42391-0f0a-4a07-8f6a-561e9b142bcb', '772baa4f-f09b-4081-9978-224c2a548abf'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Delete snapshot completed successfully.
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-30cfec47-e0b7-485b-8d49-b606b185b613-delete_snapshot" released by "delete_snapshot" :: held 7.861s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-3df9102f-6ed3-41f8-b8fa-e2632a414282-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-3df9102f-6ed3-41f8-b8fa-e2632a414282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-3df9102f-6ed3-41f8-b8fa-e2632a414282" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-3df9102f-6ed3-41f8-b8fa-e2632a414282" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Deleting offline snapshot 3df9102f-6ed3-41f8-b8fa-e2632a414282 of volume c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] snapshot_file for this snap is: volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67657e2-8ad9-4902-baaf-0f9a947659d2]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:28 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282
Apr 29 09:10:28 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:28 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47" returned: 0 in 1.010s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:28 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 is being set with open permissions: ugo+rw
Apr 29 09:10:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:28 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47
Apr 29 09:10:28 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:29 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282" returned: 0 in 1.050s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4038202-e88c-45b6-8da2-4677306966be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:10:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b897724e-f6f4-4f40-ae71-49fc79bec7ca]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:29 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47" returned: 0 in 0.689s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:29 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.info
Apr 29 09:10:29 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:29 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be
Apr 29 09:10:29 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:30 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.info" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:30 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.info is being set with open permissions: ugo+rw
Apr 29 09:10:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:30 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.info
Apr 29 09:10:30 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:30 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be" returned: 0 in 0.868s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:30 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282
Apr 29 09:10:30 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-ae0ef36a-bbf0-4308-9ab6-6c6717f81a11 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Terminate volume connection completed successfully.
Apr 29 09:10:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-ae0ef36a-bbf0-4308-9ab6-6c6717f81a11 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Deleting attachment fad42dae-34f6-4cc5-bb35-6493113af72e. {{(pid=83863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 29 09:10:30 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.info" returned: 0 in 0.622s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.078s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f916baf7-8063-454f-9232-0a10bf4db80a tempest-SnapshotMetadataTestJSON-1442933967 None] Create snapshot completed successfully
Apr 29 09:10:31 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282" returned: 0 in 0.735s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:31 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282
Apr 29 09:10:31 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "cinder-9c0f150b-488b-44f4-9f13-f958af192dc9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-9c0f150b-488b-44f4-9f13-f958af192dc9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "cinder-quobyte-9c0f150b-488b-44f4-9f13-f958af192dc9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-quobyte-9c0f150b-488b-44f4-9f13-f958af192dc9" acquired by "delete_volume" :: waited 0.041s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4442faa8-452a-4b80-9b3d-6bdad58efc10]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:31 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be.3df9102f-6ed3-41f8-b8fa-e2632a414282" returned: 0 in 0.900s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-3df9102f-6ed3-41f8-b8fa-e2632a414282" released by "_delete_snapshot" :: held 3.735s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" released by "delete_snapshot" :: held 3.798s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:32 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9
Apr 29 09:10:32 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "cinder-c8e7ac23-0c69-413f-acb0-022de8da0b47-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-c8e7ac23-0c69-413f-acb0-022de8da0b47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "cinder-quobyte-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Created reservations ['3c112612-6137-4002-bbbf-4e739f014806', 'e60176f4-8d6c-47f5-bd17-46e756f7e77d', '846049f4-6d86-4e5a-9ec2-be1a3b73ba4d', 'c7547a1d-d6ee-4ef0-a34b-a8cb4d619f2b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-quobyte-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" acquired by "delete_snapshot" :: waited 0.066s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "cinder-quobyte-c8e7ac23-0c69-413f-acb0-022de8da0b47" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-quobyte-c8e7ac23-0c69-413f-acb0-022de8da0b47" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Deleting offline snapshot c8e7ac23-0c69-413f-acb0-022de8da0b47 of volume 4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] snapshot_file for this snap is: volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5262ce1-691f-474d-8276-86d89b690d5c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:32 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Delete snapshot completed successfully.
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-3df9102f-6ed3-41f8-b8fa-e2632a414282-delete_snapshot" released by "delete_snapshot" :: held 4.517s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Snapshots deleted, issuing volume delete {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:32 devstack sudo[88846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47
Apr 29 09:10:32 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[792ba286-f492-4b67-8e16-b9341a4f3b49]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:33 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be
Apr 29 09:10:33 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:33 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9" returned: 0 in 1.573s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:33 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9
Apr 29 09:10:33 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:33 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47" returned: 0 in 1.248s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:10:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa93bc5-cf28-4b18-958c-0e2a554edf68]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:34 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e
Apr 29 09:10:34 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:34 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be" returned: 0 in 1.356s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:34 devstack sudo[88874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be
Apr 29 09:10:34 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:34 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9c0f150b-488b-44f4-9f13-f958af192dc9" returned: 0 in 0.986s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-quobyte-9c0f150b-488b-44f4-9f13-f958af192dc9" released by "delete_volume" :: held 2.685s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG cinder.quota [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Created reservations ['26b926d2-ad9b-419a-ac09-ea490d6a9abd', '7792b7c4-b887-4706-ad2c-24b2d4461288', 'ee96ffc1-84ff-468e-be5c-cb53e795b0df', 'b4a46d56-496e-4855-8984-5ae000674d0a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=85,cinder:UPDATE=87,cinder:INSERT=32,cinder:DELETE=9 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:34 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" returned: 0 in 0.945s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:34 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:10:34 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:34 devstack sudo[88882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47
Apr 29 09:10:34 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:35 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c4038202-e88c-45b6-8da2-4677306966be" returned: 0 in 1.317s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-c4038202-e88c-45b6-8da2-4677306966be" released by "delete_volume" :: held 2.838s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-39d0eeef-7402-40c8-982f-ecf375066c99 tempest-VolumesActionsTest-1973512944 None] Acquiring lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" by "attach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:35 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Created reservations ['302a3d82-4665-4af9-9b48-d8adf3f6c40d', 'b246b96c-70bb-404e-adc2-490f6b503c56', '89a51ef5-2c46-4d1c-9ec8-96ca9ebe2ed2', 'eb6f5b08-ed4e-4384-89ae-fd02f37e2c29'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-39d0eeef-7402-40c8-982f-ecf375066c99 tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" acquired by "attach_volume" :: waited 0.047s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-39d0eeef-7402-40c8-982f-ecf375066c99 tempest-VolumesActionsTest-1973512944 None] Attaching volume 93b53c1c-25c8-4020-8e02-0c8a1076c3c2 to instance 31b95621-2403-47f0-86db-879a1ed865da at mountpoint /dev/vdb on host None.
Apr 29 09:10:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-39d0eeef-7402-40c8-982f-ecf375066c99 tempest-VolumesActionsTest-1973512944 None] Attach volume completed successfully.
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-39d0eeef-7402-40c8-982f-ecf375066c99 tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" released by "attach_volume" :: held 0.276s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:36 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.212s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.manager [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:10:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Deleted volume successfully.
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:36 devstack sudo[88890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-a8c8ad39-9480-43bd-85e8-7ee6d2b0ec99 req-b28ced3f-b8a4-433a-bea2-3c25b95179e3 tempest-ServerBootFromVolumeStableRescueTest-1492915884 None] Lock "cinder-9c0f150b-488b-44f4-9f13-f958af192dc9-delete_volume" released by "delete_volume" :: held 4.497s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:36 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4a7cb928-76dc-4abb-83b2-c795a98a973f tempest-VolumesActionsTest-1973512944 None] Acquiring lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:36 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47" returned: 0 in 1.543s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4a7cb928-76dc-4abb-83b2-c795a98a973f tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4a7cb928-76dc-4abb-83b2-c795a98a973f tempest-VolumesActionsTest-1973512944 None] Detaching volume 93b53c1c-25c8-4020-8e02-0c8a1076c3c2 from instance 31b95621-2403-47f0-86db-879a1ed865da.
Apr 29 09:10:36 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47
Apr 29 09:10:36 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4a7cb928-76dc-4abb-83b2-c795a98a973f tempest-VolumesActionsTest-1973512944 None] Detach volume completed successfully.
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4a7cb928-76dc-4abb-83b2-c795a98a973f tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:36 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.778s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:10:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Deleted volume successfully.
Apr 29 09:10:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6d143d62-0fdb-4c4e-b0fe-85b8970963d2 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-c4038202-e88c-45b6-8da2-4677306966be-delete_volume" released by "delete_volume" :: held 16.739s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:37 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e.c8e7ac23-0c69-413f-acb0-022de8da0b47" returned: 0 in 0.790s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-quobyte-c8e7ac23-0c69-413f-acb0-022de8da0b47" released by "_delete_snapshot" :: held 4.821s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-quobyte-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" released by "delete_snapshot" :: held 4.895s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:37 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Created reservations ['d42a8d9f-398a-4989-873a-0c57bc2a7c1c', '27ea358c-1172-438d-a666-85f90f293a79', '6a32ab39-755d-4517-9ebd-b19fb207e76f', '6aee5cf7-c54b-4db1-b8b1-4604ebc5a98f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Delete snapshot completed successfully.
Apr 29 09:10:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-979ab5e1-1682-4ec2-a3c0-7988e219812d tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-c8e7ac23-0c69-413f-acb0-022de8da0b47-delete_snapshot" released by "delete_snapshot" :: held 5.165s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "cinder-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "cinder-quobyte-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-quobyte-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ca9b0f-383d-4b34-99e7-6ba16b91a0b9]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Flow 'volume_create_manager' (58dfb757-e0f9-45c5-826b-6ff018953128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7986d0a0-704c-45d0-8395-032269dc92d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7986d0a0-704c-45d0-8395-032269dc92d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1889902202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb3f341-77f0-40af-9378-b96dfea0e474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee00df5580484a2094da60e4f75aae46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:38Z,use_quota=True,user_id='5a77aa053e08446e98a99af141c7562e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862a138b-b39d-40f6-835f-61f10adfbb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862a138b-b39d-40f6-835f-61f10adfbb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2e967f-4809-4090-a01b-7095be6799cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2e967f-4809-4090-a01b-7095be6799cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb3f341-77f0-40af-9378-b96dfea0e474', 'volume_name': 'volume-efb3f341-77f0-40af-9378-b96dfea0e474', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69abe046-671f-4cab-b71f-63ea2a193add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69abe046-671f-4cab-b71f-63ea2a193add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99684ea5-a540-4137-b322-01ad326e730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Volume efb3f341-77f0-40af-9378-b96dfea0e474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb3f341-77f0-40af-9378-b96dfea0e474', 'volume_size': 1}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1889902202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb3f341-77f0-40af-9378-b96dfea0e474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee00df5580484a2094da60e4f75aae46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:38Z,use_quota=True,user_id='5a77aa053e08446e98a99af141c7562e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Creating volume efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:38 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:10:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:38 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e
Apr 29 09:10:38 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:38 devstack sudo[88960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 1073741824
Apr 29 09:10:38 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:39 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" returned: 0 in 1.092s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:39 devstack sudo[88975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e
Apr 29 09:10:39 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:39 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 1073741824" returned: 0 in 1.089s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:39 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474
Apr 29 09:10:39 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:40 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" returned: 0 in 0.840s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-quobyte-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e" released by "delete_volume" :: held 2.133s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Created reservations ['42c266d7-ef88-4a0f-8a62-e069e00b365a', '212465da-34d0-49ac-a358-9d248daa4796', 'f7d47ed3-a978-4729-b160-716eafd32497', 'e9d254bc-52ac-467d-84e1-2d0459f8e383'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:40 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474" returned: 0 in 0.741s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99684ea5-a540-4137-b322-01ad326e730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb3f341-77f0-40af-9378-b96dfea0e474', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08c0472-ccd1-4a55-b9f8-38a7f0b02b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Volume volume-efb3f341-77f0-40af-9378-b96dfea0e474 (efb3f341-77f0-40af-9378-b96dfea0e474): created successfully
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08c0472-ccd1-4a55-b9f8-38a7f0b02b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Flow 'volume_create_manager' (58dfb757-e0f9-45c5-826b-6ff018953128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-28b25c2c-a139-432a-b490-bcd3ef057644 tempest-VolumesDeleteCascade-460215370 None] Created volume successfully.
Apr 29 09:10:40 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:10:40 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:41 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.605s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:10:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Deleted volume successfully.
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1ab4d4e5-cfea-4345-b9d8-b02ae8133a10 tempest-SnapshotMetadataTestJSON-1442933967 None] Lock "cinder-4ed170f9-999b-4a2f-bcd1-3f3f1e16381e-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Creating offline snapshot 5fcf9604-4b72-4603-a174-585a3ee0d685 of volume efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f7b2e4-c2d6-49fa-bbce-2656e58bf18d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:41 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474
Apr 29 09:10:41 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:42 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474" returned: 0 in 0.774s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:42 devstack sudo[88994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 1G
Apr 29 09:10:42 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:43 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 1G" returned: 0 in 0.921s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb3f341-77f0-40af-9378-b96dfea0e474 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:43 devstack sudo[89001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb3f341-77f0-40af-9378-b96dfea0e474 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685
Apr 29 09:10:43 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:44 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efb3f341-77f0-40af-9378-b96dfea0e474 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685" returned: 0 in 0.718s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:44 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 is being set with open permissions: ugo+rw
Apr 29 09:10:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:44 devstack sudo[89007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685
Apr 29 09:10:44 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:44 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:44 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.info
Apr 29 09:10:44 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:45 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.info" returned: 0 in 0.756s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:45 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.info is being set with open permissions: ugo+rw
Apr 29 09:10:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:45 devstack sudo[89016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.info
Apr 29 09:10:45 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:46 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.info" returned: 0 in 0.667s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.710s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ab4aeb28-2589-47a2-8070-3e75931b2b32 tempest-VolumesDeleteCascade-460215370 None] Create snapshot completed successfully
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Flow 'volume_create_manager' (be0666ec-ebaf-407c-9a89-4dce409a56c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b9d626-a6ad-4db7-94a9-71362dcecee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b9d626-a6ad-4db7-94a9-71362dcecee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-276624043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7cb650-f1d1-40bf-b163-5861b17422d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62132eee1895480aa787c8d15de9bb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:47Z,use_quota=True,user_id='eae1bd00249e46da92b5ef779463a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77787871-88d7-4ade-ba3c-9ea781595fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77787871-88d7-4ade-ba3c-9ea781595fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e962389c-fca1-440b-9fa5-0711f4ed0e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e962389c-fca1-440b-9fa5-0711f4ed0e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7cb650-f1d1-40bf-b163-5861b17422d4', 'volume_name': 'volume-1f7cb650-f1d1-40bf-b163-5861b17422d4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e46d55-548a-4543-9207-a98e68d128fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e46d55-548a-4543-9207-a98e68d128fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4779d2fc-5417-4713-b3b1-63d25cd2e9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Volume 1f7cb650-f1d1-40bf-b163-5861b17422d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7cb650-f1d1-40bf-b163-5861b17422d4', 'volume_size': 1}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-276624043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7cb650-f1d1-40bf-b163-5861b17422d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62132eee1895480aa787c8d15de9bb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:47Z,use_quota=True,user_id='eae1bd00249e46da92b5ef779463a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Creating volume 1f7cb650-f1d1-40bf-b163-5861b17422d4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:47 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:47 devstack sudo[89019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4 1073741824
Apr 29 09:10:47 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Flow 'volume_create_manager' (eeb3e297-bfde-4c65-8146-3b6e1feab4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676d69cd-30c5-47dd-a5e4-54cd45680c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676d69cd-30c5-47dd-a5e4-54cd45680c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-624304967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b556633e-a233-4078-9cfe-0688fe8186a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee00df5580484a2094da60e4f75aae46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5fcf9604-4b72-4603-a174-585a3ee0d685,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:47Z,use_quota=True,user_id='5a77aa053e08446e98a99af141c7562e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78077307-35fa-4db6-af1a-d0f371c3f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78077307-35fa-4db6-af1a-d0f371c3f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f0cfe4-cc44-440e-a214-e4ce59f4ba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f0cfe4-cc44-440e-a214-e4ce59f4ba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b556633e-a233-4078-9cfe-0688fe8186a3', 'volume_name': 'volume-b556633e-a233-4078-9cfe-0688fe8186a3', 'volume_size': 1, 'snapshot_id': '5fcf9604-4b72-4603-a174-585a3ee0d685'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cfaf68-1ac1-48f3-90e0-ace51fd222f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cfaf68-1ac1-48f3-90e0-ace51fd222f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57f6cad-ba70-400a-86ca-9740ff4decc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Volume b556633e-a233-4078-9cfe-0688fe8186a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b556633e-a233-4078-9cfe-0688fe8186a3', 'volume_size': 1, 'snapshot_id': '5fcf9604-4b72-4603-a174-585a3ee0d685'}
Apr 29 09:10:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:48 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4 1073741824" returned: 0 in 1.012s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:48 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4
Apr 29 09:10:48 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:48 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.034s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-5fcf9604-4b72-4603-a174-585a3ee0d685-b556633e-a233-4078-9cfe-0688fe8186a3" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4779d2fc-5417-4713-b3b1-63d25cd2e9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7cb650-f1d1-40bf-b163-5861b17422d4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d9d24f-a345-42c6-bcec-c7ccb785e0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-5fcf9604-4b72-4603-a174-585a3ee0d685-b556633e-a233-4078-9cfe-0688fe8186a3" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Creating volume b556633e-a233-4078-9cfe-0688fe8186a3 from snapshot 5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-b556633e-a233-4078-9cfe-0688fe8186a3" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:48 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Volume volume-1f7cb650-f1d1-40bf-b163-5861b17422d4 (1f7cb650-f1d1-40bf-b163-5861b17422d4): created successfully
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d9d24f-a345-42c6-bcec-c7ccb785e0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Flow 'volume_create_manager' (be0666ec-ebaf-407c-9a89-4dce409a56c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-b556633e-a233-4078-9cfe-0688fe8186a3" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] snapshot: 5fcf9604-4b72-4603-a174-585a3ee0d685, volume: b556633e-a233-4078-9cfe-0688fe8186a3,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:10:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2caee139-b2a9-478e-b1d6-56c223acfbd4 tempest-VolumesTransfersV355Test-387456991 None] Created volume successfully.
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1b9938-4637-4f3e-aa07-b4c02f1ae15a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:49 devstack sudo[89029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685
Apr 29 09:10:49 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:49 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685" returned: 0 in 0.794s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efb3f341-77f0-40af-9378-b96dfea0e474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:10:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:10:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:10:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe65f0a-3f95-4c3c-9e63-3b977ef1acd6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:49 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474
Apr 29 09:10:49 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-00b5830b-29c9-4d57-ba1c-d3a3852bcbcf tempest-VolumesTransfersV355Test-1155537130 None] Transfer volume completed successfully.
Apr 29 09:10:50 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474" returned: 0 in 0.854s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:50 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:10:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:50 devstack sudo[89041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3
Apr 29 09:10:50 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Acquiring lock "cinder-1f7cb650-f1d1-40bf-b163-5861b17422d4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-1f7cb650-f1d1-40bf-b163-5861b17422d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Acquiring lock "cinder-quobyte-1f7cb650-f1d1-40bf-b163-5861b17422d4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-quobyte-1f7cb650-f1d1-40bf-b163-5861b17422d4" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:51 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbbd25f-2d42-4530-b796-7757265d4294]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:51 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4
Apr 29 09:10:51 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Flow 'volume_create_manager' (9dbccee1-318e-4d11-a762-1da99d516b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0bee96-e2ae-486d-a8aa-80612788fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0bee96-e2ae-486d-a8aa-80612788fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1959704138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b6e7d8-1a09-43e9-9a11-34851ddf907a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2232ead68d294885a978cab0a74e2ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:52Z,use_quota=True,user_id='edb882ff26f340b1952de44944f0e889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0253d4c0-1fa0-4f91-ba7f-c6432d0261f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0253d4c0-1fa0-4f91-ba7f-c6432d0261f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0043a817-e2f2-45a4-9dbd-9fffcff333f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0043a817-e2f2-45a4-9dbd-9fffcff333f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b6e7d8-1a09-43e9-9a11-34851ddf907a', 'volume_name': 'volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb658198-98b6-436e-9955-95b522c3fe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb658198-98b6-436e-9955-95b522c3fe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccba64e7-301a-4146-808d-eee4e45abe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Volume 85b6e7d8-1a09-43e9-9a11-34851ddf907a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a', 'volume_size': 1}
Apr 29 09:10:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:53 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4" returned: 0 in 1.794s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:53 devstack sudo[89068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4
Apr 29 09:10:53 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:54 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1f7cb650-f1d1-40bf-b163-5861b17422d4" returned: 0 in 1.677s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-quobyte-1f7cb650-f1d1-40bf-b163-5861b17422d4" released by "delete_volume" :: held 3.556s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:55 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Created reservations ['3d85fc63-8b09-4c6d-9b40-34359f3bcd42', '6329cf6a-3dba-44f0-b557-610cb1e442b0', 'f2b4646d-82c8-4cf5-81d0-a773e0f8f830', 'c9ca1406-258f-444a-8167-d9ede371c1fc'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:10:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:55 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:10:55 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:56 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.494s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:56 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:10:56 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Deleted volume successfully.
Apr 29 09:10:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ba76635d-a8ab-4ee4-b4ee-66c2d3e80685 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-1f7cb650-f1d1-40bf-b163-5861b17422d4-delete_volume" released by "delete_volume" :: held 5.574s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:56 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3" returned: 0 in 6.285s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:56 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4732bc-90a9-46ec-9b7c-8cbc3aaf9c6f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:56 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474
Apr 29 09:10:56 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Flow 'volume_create_manager' (fcc05d7a-6049-44ad-b133-0a438fa4d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79c2b39-9569-4f60-9798-3c62bf5a78ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79c2b39-9569-4f60-9798-3c62bf5a78ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-335726443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8238eb7-4f83-46ac-886d-d18650bc532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62132eee1895480aa787c8d15de9bb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:57Z,use_quota=True,user_id='eae1bd00249e46da92b5ef779463a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ee8cbe-1994-43ab-b685-c12fe343d5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ee8cbe-1994-43ab-b685-c12fe343d5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d9108-5a37-4958-8dae-d1f253e4f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (957d9108-5a37-4958-8dae-d1f253e4f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8238eb7-4f83-46ac-886d-d18650bc532b', 'volume_name': 'volume-d8238eb7-4f83-46ac-886d-d18650bc532b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514fb03f-f750-45fe-ac6d-6465b18c6bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514fb03f-f750-45fe-ac6d-6465b18c6bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdea5fcc-5041-4958-b3c4-447676467a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Volume d8238eb7-4f83-46ac-886d-d18650bc532b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8238eb7-4f83-46ac-886d-d18650bc532b', 'volume_size': 1}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:57 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:10:57 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Converted 1024.00 MB image at 162.91 MB/s
Apr 29 09:10:57 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3 is being set with open permissions: ugo+rw
Apr 29 09:10:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:57 devstack sudo[89088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3
Apr 29 09:10:57 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:58 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-b556633e-a233-4078-9cfe-0688fe8186a3" released by "_copy_volume_from_snapshot" :: held 9.601s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-5fcf9604-4b72-4603-a174-585a3ee0d685-b556633e-a233-4078-9cfe-0688fe8186a3" released by "_create_volume_from_snapshot" :: held 9.644s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.684s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.022s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1959704138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b6e7d8-1a09-43e9-9a11-34851ddf907a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2232ead68d294885a978cab0a74e2ecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:52Z,use_quota=True,user_id='edb882ff26f340b1952de44944f0e889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Creating volume 85b6e7d8-1a09-43e9-9a11-34851ddf907a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:10:58 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:58 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a 1073741824
Apr 29 09:10:58 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57f6cad-ba70-400a-86ca-9740ff4decc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b556633e-a233-4078-9cfe-0688fe8186a3', 'volume_size': 1, 'snapshot_id': '5fcf9604-4b72-4603-a174-585a3ee0d685'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4ea01b-89fc-42fd-8cc3-b29d115df431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:10:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Volume volume-b556633e-a233-4078-9cfe-0688fe8186a3 (b556633e-a233-4078-9cfe-0688fe8186a3): created successfully
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4ea01b-89fc-42fd-8cc3-b29d115df431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Flow 'volume_create_manager' (eeb3e297-bfde-4c65-8146-3b6e1feab4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:10:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-24c82fce-f9b7-4788-90c3-002bf5b221aa tempest-VolumesDeleteCascade-460215370 None] Created volume successfully.
Apr 29 09:10:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-efb3f341-77f0-40af-9378-b96dfea0e474-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-efb3f341-77f0-40af-9378-b96dfea0e474-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Performing cascade delete. {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-5fcf9604-4b72-4603-a174-585a3ee0d685-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-5fcf9604-4b72-4603-a174-585a3ee0d685-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-efb3f341-77f0-40af-9378-b96dfea0e474" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-efb3f341-77f0-40af-9378-b96dfea0e474" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-5fcf9604-4b72-4603-a174-585a3ee0d685" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-5fcf9604-4b72-4603-a174-585a3ee0d685" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Deleting offline snapshot 5fcf9604-4b72-4603-a174-585a3ee0d685 of volume efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:10:59 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:10:59 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] snapshot_file for this snap is: volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b956018-38b7-46e5-9548-94119dfeb8f5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:59 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a 1073741824" returned: 0 in 0.940s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:10:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:10:59 devstack sudo[89103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685
Apr 29 09:10:59 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:10:59 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a
Apr 29 09:10:59 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:00 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.974s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a" returned: 0 in 1.229s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:11:00 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.521s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-335726443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8238eb7-4f83-46ac-886d-d18650bc532b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62132eee1895480aa787c8d15de9bb02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:10:57Z,use_quota=True,user_id='eae1bd00249e46da92b5ef779463a11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Creating volume d8238eb7-4f83-46ac-886d-d18650bc532b {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:11:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:00 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685" returned: 0 in 1.440s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efb3f341-77f0-40af-9378-b96dfea0e474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:11:00 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b 1073741824
Apr 29 09:11:00 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccba64e7-301a-4146-808d-eee4e45abe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa313c58-607d-4180-85de-e720c5f667ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19bea26-dc4e-43a8-961e-2ff6fe383d0b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Volume volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a (85b6e7d8-1a09-43e9-9a11-34851ddf907a): created successfully
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa313c58-607d-4180-85de-e720c5f667ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Flow 'volume_create_manager' (9dbccee1-318e-4d11-a762-1da99d516b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-837ca5c7-dc32-4f0d-8b0a-75bac92632a1 req-9bdef91d-95ea-4c78-97f9-603bb73d2940 tempest-VolumesGetTestJSON-934298702 None] Created volume successfully.
Apr 29 09:11:00 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474
Apr 29 09:11:00 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:01 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474" returned: 0 in 0.809s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:01 devstack sudo[89187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685
Apr 29 09:11:01 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:01 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b 1073741824" returned: 0 in 1.003s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:01 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b
Apr 29 09:11:01 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Acquiring lock "cinder-85b6e7d8-1a09-43e9-9a11-34851ddf907a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Lock "cinder-85b6e7d8-1a09-43e9-9a11-34851ddf907a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Acquiring lock "cinder-quobyte-85b6e7d8-1a09-43e9-9a11-34851ddf907a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Lock "cinder-quobyte-85b6e7d8-1a09-43e9-9a11-34851ddf907a" acquired by "delete_volume" :: waited 0.067s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[66942632-58f1-4926-9242-9543efeed73b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:02 devstack sudo[89191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a
Apr 29 09:11:02 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:02 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685" returned: 0 in 1.112s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:02 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685
Apr 29 09:11:02 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:02 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b" returned: 0 in 1.113s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdea5fcc-5041-4958-b3c4-447676467a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8238eb7-4f83-46ac-886d-d18650bc532b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d7ad86-af8d-4290-8ca4-607b42b056ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Volume volume-d8238eb7-4f83-46ac-886d-d18650bc532b (d8238eb7-4f83-46ac-886d-d18650bc532b): created successfully
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d7ad86-af8d-4290-8ca4-607b42b056ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Flow 'volume_create_manager' (fcc05d7a-6049-44ad-b133-0a438fa4d031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-18c3418c-912d-4173-9a72-8c2510e6aa22 tempest-VolumesTransfersV355Test-387456991 None] Created volume successfully.
Apr 29 09:11:03 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a" returned: 0 in 1.022s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:03 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a
Apr 29 09:11:03 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:03 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474.5fcf9604-4b72-4603-a174-585a3ee0d685" returned: 0 in 0.677s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-5fcf9604-4b72-4603-a174-585a3ee0d685" released by "_delete_snapshot" :: held 4.208s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-efb3f341-77f0-40af-9378-b96dfea0e474" released by "delete_snapshot" :: held 4.261s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=106,cinder:SELECT=92,cinder:INSERT=27,cinder:DELETE=11 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Created reservations ['595a1362-713a-4e65-b028-50a7fd4bfa96', '0aee0ae0-bc11-4572-b80e-63260054b931', 'a20f1579-bc60-4fc4-a827-655b620c2df3', '7db329af-800c-4608-9f9e-bfabefdca15b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Delete snapshot completed successfully.
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-5fcf9604-4b72-4603-a174-585a3ee0d685-delete_snapshot" released by "delete_snapshot" :: held 4.522s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Snapshots deleted, issuing volume delete {{(pid=83863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-efb3f341-77f0-40af-9378-b96dfea0e474" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-efb3f341-77f0-40af-9378-b96dfea0e474" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3e555d-7587-45df-a6e8-dab5d989f2fd]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-85f6a6d8-85db-4cee-b03c-1035f6ef1b66 tempest-VolumesActionsTest-1973512944 None] Acquiring lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" by "attach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-85f6a6d8-85db-4cee-b03c-1035f6ef1b66 tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" acquired by "attach_volume" :: waited 0.051s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:03 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474
Apr 29 09:11:03 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-85f6a6d8-85db-4cee-b03c-1035f6ef1b66 tempest-VolumesActionsTest-1973512944 None] Attaching volume 93b53c1c-25c8-4020-8e02-0c8a1076c3c2 to instance 83d8c631-d413-4790-948f-8f47d964ba34 at mountpoint /dev/vdb on host None.
Apr 29 09:11:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-85f6a6d8-85db-4cee-b03c-1035f6ef1b66 tempest-VolumesActionsTest-1973512944 None] Attach volume completed successfully.
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-85f6a6d8-85db-4cee-b03c-1035f6ef1b66 tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" released by "attach_volume" :: held 0.185s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Acquiring lock "cinder-d8238eb7-4f83-46ac-886d-d18650bc532b-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-d8238eb7-4f83-46ac-886d-d18650bc532b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Acquiring lock "cinder-quobyte-d8238eb7-4f83-46ac-886d-d18650bc532b" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-quobyte-d8238eb7-4f83-46ac-886d-d18650bc532b" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e90f4cd-40e7-4194-82a6-a3c8d2cc7c3d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:04 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85b6e7d8-1a09-43e9-9a11-34851ddf907a" returned: 0 in 1.014s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Lock "cinder-quobyte-85b6e7d8-1a09-43e9-9a11-34851ddf907a" released by "delete_volume" :: held 2.158s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:04 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b
Apr 29 09:11:04 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.quota [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Created reservations ['b3952369-7f68-49b5-b065-e36363fbd6f5', 'e48ec10b-736f-424e-a8fe-776bc7d50515', 'db356d60-fe72-48b6-9447-4e9c370d7f7c', '29db1523-6d7a-4881-8913-04f9fea11a57'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:04 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:04 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-12c38567-bb36-4f47-a9a9-8fc11ec6574b tempest-VolumesActionsTest-1973512944 None] Acquiring lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-detach_volume" by "detach_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-12c38567-bb36-4f47-a9a9-8fc11ec6574b tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-12c38567-bb36-4f47-a9a9-8fc11ec6574b tempest-VolumesActionsTest-1973512944 None] Detaching volume 93b53c1c-25c8-4020-8e02-0c8a1076c3c2 from instance 83d8c631-d413-4790-948f-8f47d964ba34.
Apr 29 09:11:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-12c38567-bb36-4f47-a9a9-8fc11ec6574b tempest-VolumesActionsTest-1973512944 None] Detach volume completed successfully.
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-12c38567-bb36-4f47-a9a9-8fc11ec6574b tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:04 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474" returned: 0 in 1.174s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:04 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474
Apr 29 09:11:04 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:05 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG cinder.manager [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Deleted volume successfully.
Apr 29 09:11:05 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b" returned: 0 in 1.150s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:05 devstack sudo[89222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b
Apr 29 09:11:05 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [req-8c7c3bd8-d73e-488e-b917-ead0854d2293 req-c184f772-e0f1-4ae0-8045-05c61b04c23b tempest-VolumesGetTestJSON-934298702 None] Lock "cinder-85b6e7d8-1a09-43e9-9a11-34851ddf907a-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:05 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-efb3f341-77f0-40af-9378-b96dfea0e474" returned: 0 in 0.885s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-efb3f341-77f0-40af-9378-b96dfea0e474" released by "delete_volume" :: held 2.178s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:05 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Created reservations ['9937e582-f864-4c85-a06e-dbf6dbaa7a48', 'af6fb9f0-05c3-4161-902e-01b601a0dc62', 'cd3892ef-bc94-47a8-b0ab-f74a6f69fd9e', '3dd69d57-464b-434e-80b5-e853171c93a8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:06 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:06 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:06 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d8238eb7-4f83-46ac-886d-d18650bc532b" returned: 0 in 0.752s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-quobyte-d8238eb7-4f83-46ac-886d-d18650bc532b" released by "delete_volume" :: held 1.965s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Created reservations ['aa247f60-8371-4d3d-8b67-254f569302f4', '253571f5-d5f9-46ea-bbb1-28a5330b8c55', '2e4c74ff-c722-4558-9b60-6bdae04acafd', '85839dd8-14f5-4c0b-bc91-2dfd75840486'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:06 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:06 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:07 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.177s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Deleted volume successfully.
Apr 29 09:11:07 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-b556633e-a233-4078-9cfe-0688fe8186a3-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.986s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-b556633e-a233-4078-9cfe-0688fe8186a3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Deleted volume successfully.
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-78a58217-bc33-4d23-9dad-e76bd7db6f00 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-efb3f341-77f0-40af-9378-b96dfea0e474-delete_volume" released by "delete_volume" :: held 8.370s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "cinder-quobyte-b556633e-a233-4078-9cfe-0688fe8186a3" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82d96534-4a32-4b30-878b-1c84498ffa39 tempest-VolumesTransfersV355Test-1230214031 None] Lock "cinder-d8238eb7-4f83-46ac-886d-d18650bc532b-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-b556633e-a233-4078-9cfe-0688fe8186a3" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d2ca7d-af11-4548-ad97-732556393d5f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:07 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3
Apr 29 09:11:07 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:08 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3" returned: 0 in 1.144s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:08 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3
Apr 29 09:11:08 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:09 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b556633e-a233-4078-9cfe-0688fe8186a3" returned: 0 in 0.761s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-quobyte-b556633e-a233-4078-9cfe-0688fe8186a3" released by "delete_volume" :: held 1.996s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Created reservations ['c680545d-3467-4eed-b5d6-8170d017b0b6', '5eb15683-985f-4037-8dfb-cffbd025c7bd', '1d379070-73c1-4644-b8a2-9ac86648bb47', '1773b45a-020a-4d55-bf27-2fbec03ef071'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:09 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:09 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:10 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.827s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Deleted volume successfully.
Apr 29 09:11:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-974e61f0-a948-4297-90a9-6d927130a699 tempest-VolumesDeleteCascade-460215370 None] Lock "cinder-b556633e-a233-4078-9cfe-0688fe8186a3-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Flow 'volume_create_manager' (b31366c9-c067-4c23-9d72-7fe17a9ac52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9795a0c8-8f7d-4c2c-857e-59c75b1b8ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9795a0c8-8f7d-4c2c-857e-59c75b1b8ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1601660722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26245a74-1e57-4429-bbe3-eee17b1af15a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca54db966cd46b7a252696511c3e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:11Z,use_quota=True,user_id='b8196df1bc2c4b72b7abe359970b99e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5b360-8059-42b6-81c5-c1cade6afb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5b360-8059-42b6-81c5-c1cade6afb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f5ae1-e49a-4ad4-b7f7-51a74a273ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f5ae1-e49a-4ad4-b7f7-51a74a273ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26245a74-1e57-4429-bbe3-eee17b1af15a', 'volume_name': 'volume-26245a74-1e57-4429-bbe3-eee17b1af15a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabc8537-d5a3-4754-aab2-f7ab016abc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabc8537-d5a3-4754-aab2-f7ab016abc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0700ed-017b-4d51-ac3e-234f26bb657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Volume 26245a74-1e57-4429-bbe3-eee17b1af15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26245a74-1e57-4429-bbe3-eee17b1af15a', 'volume_size': 1}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1601660722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26245a74-1e57-4429-bbe3-eee17b1af15a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca54db966cd46b7a252696511c3e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:11Z,use_quota=True,user_id='b8196df1bc2c4b72b7abe359970b99e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Creating volume 26245a74-1e57-4429-bbe3-eee17b1af15a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:11:11 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:11:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:11 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a 1073741824
Apr 29 09:11:11 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:12 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a 1073741824" returned: 0 in 1.078s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:12 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a
Apr 29 09:11:12 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:13 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a" returned: 0 in 0.834s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:11:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0700ed-017b-4d51-ac3e-234f26bb657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26245a74-1e57-4429-bbe3-eee17b1af15a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cce3ffa-f299-47db-a0d9-86d81176596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Volume volume-26245a74-1e57-4429-bbe3-eee17b1af15a (26245a74-1e57-4429-bbe3-eee17b1af15a): created successfully
Apr 29 09:11:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cce3ffa-f299-47db-a0d9-86d81176596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Flow 'volume_create_manager' (b31366c9-c067-4c23-9d72-7fe17a9ac52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aa754756-c13d-45a7-a728-ffed6f74a52f tempest-VolumesTestJSON-791427542 None] Created volume successfully.
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Flow 'volume_create_manager' (18116b30-d1f1-49a2-acf0-d6c72f561096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e506ff-bf76-4f14-8d64-fc124392d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e506ff-bf76-4f14-8d64-fc124392d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1688966312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38708862-4302-4e69-9ff3-3ca3bbc57f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e4c2d7833244809e6c09f98cc61f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:14Z,use_quota=True,user_id='c5a969f64338476c957a6601a65c3b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a23f6c0-0202-48fd-878a-edb299fec788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a23f6c0-0202-48fd-878a-edb299fec788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b09908-3941-44f7-b2a7-148d5b134f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b09908-3941-44f7-b2a7-148d5b134f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38708862-4302-4e69-9ff3-3ca3bbc57f0e', 'volume_name': 'volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabc1184-a9e8-4758-8784-515e49ab14ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabc1184-a9e8-4758-8784-515e49ab14ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97db7824-9a78-4837-a55f-e443398e2bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Volume 38708862-4302-4e69-9ff3-3ca3bbc57f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e', 'volume_size': 1}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1688966312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38708862-4302-4e69-9ff3-3ca3bbc57f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e4c2d7833244809e6c09f98cc61f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:14Z,use_quota=True,user_id='c5a969f64338476c957a6601a65c3b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Creating volume 38708862-4302-4e69-9ff3-3ca3bbc57f0e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:11:14 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:14 devstack sudo[89295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e 1073741824
Apr 29 09:11:14 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Flow 'volume_create_manager' (6eeaa9ec-6618-4ce1-90df-5a40b586965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b611dab-dd33-48f7-9679-d4cb514f1ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b611dab-dd33-48f7-9679-d4cb514f1ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-466812558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8a2809-35c4-4c40-8ee7-249df65efce8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca54db966cd46b7a252696511c3e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:15Z,use_quota=True,user_id='b8196df1bc2c4b72b7abe359970b99e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31b706d-1347-4365-baae-c0d2c07a3be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31b706d-1347-4365-baae-c0d2c07a3be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08262624-2c76-4955-9547-ff52183a8932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08262624-2c76-4955-9547-ff52183a8932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8a2809-35c4-4c40-8ee7-249df65efce8', 'volume_name': 'volume-aa8a2809-35c4-4c40-8ee7-249df65efce8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d8689-617b-4a39-bef5-84d837b933a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d8689-617b-4a39-bef5-84d837b933a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807683b7-70d1-4b1b-bbad-ec404cb46268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Volume aa8a2809-35c4-4c40-8ee7-249df65efce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8a2809-35c4-4c40-8ee7-249df65efce8', 'volume_size': 1}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e 1073741824" returned: 0 in 0.899s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:15 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e
Apr 29 09:11:15 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Flow 'volume_create_manager' (843ffd7a-c391-4c76-92b2-90b03a1fedaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b3ccf8-d7df-4a1e-8118-e91d01dbedfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b3ccf8-d7df-4a1e-8118-e91d01dbedfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-756965353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e457aec-c862-49f0-874b-f1ea0c782c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede3078db5ad4e0abfb74a49b1d1c614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:16Z,use_quota=True,user_id='d2ee93cb9fd34d59929b794f8c97a359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cad771-9796-464a-b9af-929c23bcb6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79cad771-9796-464a-b9af-929c23bcb6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff62fac-ad92-4455-9db0-3c3d1314a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff62fac-ad92-4455-9db0-3c3d1314a794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e457aec-c862-49f0-874b-f1ea0c782c93', 'volume_name': 'volume-5e457aec-c862-49f0-874b-f1ea0c782c93', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8417d2df-b420-4b27-94c3-359fd6301513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8417d2df-b420-4b27-94c3-359fd6301513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fff3da-81c4-443e-b648-4cb41f409633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:15 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Volume 5e457aec-c862-49f0-874b-f1ea0c782c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e457aec-c862-49f0-874b-f1ea0c782c93', 'volume_size': 1}
Apr 29 09:11:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:16 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.581s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97db7824-9a78-4837-a55f-e443398e2bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef82dee-5794-432a-bb48-0fd45871c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2845112-c2ff-4454-922d-c79dc3d127bf]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Volume volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e (38708862-4302-4e69-9ff3-3ca3bbc57f0e): created successfully
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef82dee-5794-432a-bb48-0fd45871c393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Flow 'volume_create_manager' (18116b30-d1f1-49a2-acf0-d6c72f561096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-29141381-7d62-4739-a9c6-d2d8cbc2ca5b tempest-VolumesMetadataTest-990515554 None] Created volume successfully.
Apr 29 09:11:16 devstack sudo[89304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:11:16 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:16 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.828s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e276e0a-7b6e-4f80-be57-93820302f5b8]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:17 devstack sudo[89309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:11:17 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Acquiring lock "cinder-38708862-4302-4e69-9ff3-3ca3bbc57f0e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Lock "cinder-38708862-4302-4e69-9ff3-3ca3bbc57f0e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Acquiring lock "cinder-quobyte-38708862-4302-4e69-9ff3-3ca3bbc57f0e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Lock "cinder-quobyte-38708862-4302-4e69-9ff3-3ca3bbc57f0e" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db921da4-9d65-4bd5-9721-3143481ada03]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:17 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e
Apr 29 09:11:17 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:17 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.739s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.beaaace8-51c9-4b39-834b-648a92850f9cdybwfjj4.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:17 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.beaaace8-51c9-4b39-834b-648a92850f9cdybwfjj4.img
Apr 29 09:11:17 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:18 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e" returned: 0 in 0.747s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:18 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e
Apr 29 09:11:18 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:19 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-38708862-4302-4e69-9ff3-3ca3bbc57f0e" returned: 0 in 0.886s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Lock "cinder-quobyte-38708862-4302-4e69-9ff3-3ca3bbc57f0e" released by "delete_volume" :: held 1.718s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Created reservations ['509a8451-fe6a-41d6-bdd2-50f91bfe7945', '5caaece2-8342-4b03-b2d7-f83f7e261ae3', '4a3f96bc-dbc2-47fc-9421-b5a149a7bbdb', 'efc01a82-18b9-4503-ac26-68b56735a3f2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:19 devstack sudo[89368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:19 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:21 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:21 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Deleted volume successfully.
Apr 29 09:11:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-110bfc4e-69b7-498f-b670-7afa4069960f tempest-VolumesMetadataTest-990515554 None] Lock "cinder-38708862-4302-4e69-9ff3-3ca3bbc57f0e-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:23 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.beaaace8-51c9-4b39-834b-648a92850f9cdybwfjj4.img" returned: 0 in 5.674s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecebf34-ab86-4827-9a51-48dc67c95ce6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:23 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:11:23 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:24 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.925s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:24 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.beaaace8-51c9-4b39-834b-648a92850f9cdybwfjj4.img {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:11:24 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Converted 1024.00 MB image at 180.42 MB/s
Apr 29 09:11:24 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] beaaace8-51c9-4b39-834b-648a92850f9c was raw, no need to convert to raw {{(pid=83863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Flow 'volume_create_manager' (4bcead48-0feb-4a80-be1f-d1956a0e6d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6c00f7-6a21-4af2-8eb8-2772f5559cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6c00f7-6a21-4af2-8eb8-2772f5559cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-679078893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80817726-3307-478b-b975-0f405efcd52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75f73f2aef4db3850fcf4717fce520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:26Z,use_quota=True,user_id='14ad3aa79b084cea9fb0787d8fe1325f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f75b1f-8ed0-41e8-bae6-9dbedb48f553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f75b1f-8ed0-41e8-bae6-9dbedb48f553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a30b4e-9af6-4fef-91ab-a9138a92e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a30b4e-9af6-4fef-91ab-a9138a92e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80817726-3307-478b-b975-0f405efcd52e', 'volume_name': 'volume-80817726-3307-478b-b975-0f405efcd52e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a8de4e-1de0-4bcf-bcd4-503b0651e47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a8de4e-1de0-4bcf-bcd4-503b0651e47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08055b9-ee21-442a-8597-e3eb30eb775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:26 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Volume 80817726-3307-478b-b975-0f405efcd52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80817726-3307-478b-b975-0f405efcd52e', 'volume_size': 1}
Apr 29 09:11:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:36 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=85,cinder:UPDATE=105,cinder:INSERT=30,cinder:DELETE=6 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:11:36 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:INSERT=8,cinder:UPDATE=56,cinder:SELECT=42,cinder:DELETE=5 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.644s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Uploaded volume to glance image-id: beaaace8-51c9-4b39-834b-648a92850f9c. {{(pid=83863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.370s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-466812558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8a2809-35c4-4c40-8ee7-249df65efce8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca54db966cd46b7a252696511c3e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:15Z,use_quota=True,user_id='b8196df1bc2c4b72b7abe359970b99e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Creating volume aa8a2809-35c4-4c40-8ee7-249df65efce8 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:11:42 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:11:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:42 devstack sudo[89392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8 1073741824
Apr 29 09:11:42 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-559a0313-e82f-404b-a1dd-f3115428369e tempest-VolumesActionsTest-1973512944 None] Copy volume to image completed successfully.
Apr 29 09:11:43 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8 1073741824" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:43 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8
Apr 29 09:11:43 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:44 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8" returned: 0 in 0.616s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.338s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-756965353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e457aec-c862-49f0-874b-f1ea0c782c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede3078db5ad4e0abfb74a49b1d1c614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:16Z,use_quota=True,user_id='d2ee93cb9fd34d59929b794f8c97a359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Creating volume 5e457aec-c862-49f0-874b-f1ea0c782c93 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:11:44 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807683b7-70d1-4b1b-bbad-ec404cb46268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8a2809-35c4-4c40-8ee7-249df65efce8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2b3c9e-0f2c-4079-9892-e802c6f09d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:44 devstack sudo[89403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93 1073741824
Apr 29 09:11:44 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:44 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Volume volume-aa8a2809-35c4-4c40-8ee7-249df65efce8 (aa8a2809-35c4-4c40-8ee7-249df65efce8): created successfully
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2b3c9e-0f2c-4079-9892-e802c6f09d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Flow 'volume_create_manager' (6eeaa9ec-6618-4ce1-90df-5a40b586965a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ff9f0316-365b-463c-8f8d-2a452c59f8a3 tempest-VolumesTestJSON-791427542 None] Created volume successfully.
Apr 29 09:11:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Flow 'volume_create_manager' (30f05a8f-7992-4cb0-a7eb-371756f308f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d5724f-a7f2-4f0f-9320-df210fde9295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d5724f-a7f2-4f0f-9320-df210fde9295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1694699829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bab3126-c055-4366-a56a-8ae358354a10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca54db966cd46b7a252696511c3e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:45Z,use_quota=True,user_id='b8196df1bc2c4b72b7abe359970b99e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450c4ca2-b74e-48e4-8be1-1ee0bd767650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450c4ca2-b74e-48e4-8be1-1ee0bd767650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2498929a-8b91-4400-a1fe-03082fd4a3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2498929a-8b91-4400-a1fe-03082fd4a3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bab3126-c055-4366-a56a-8ae358354a10', 'volume_name': 'volume-9bab3126-c055-4366-a56a-8ae358354a10', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42af8755-bacb-4376-8abf-7261742d298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42af8755-bacb-4376-8abf-7261742d298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34bf706-8ab9-48da-a224-51415c60a8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Volume 9bab3126-c055-4366-a56a-8ae358354a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bab3126-c055-4366-a56a-8ae358354a10', 'volume_size': 1}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:45 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93 1073741824" returned: 0 in 0.890s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:45 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93
Apr 29 09:11:45 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:45 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93" returned: 0 in 0.578s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.244s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-679078893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80817726-3307-478b-b975-0f405efcd52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75f73f2aef4db3850fcf4717fce520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:26Z,use_quota=True,user_id='14ad3aa79b084cea9fb0787d8fe1325f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Creating volume 80817726-3307-478b-b975-0f405efcd52e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:11:45 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:45 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e 1073741824
Apr 29 09:11:45 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fff3da-81c4-443e-b648-4cb41f409633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e457aec-c862-49f0-874b-f1ea0c782c93', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d062d6-73a0-4764-905d-57732beeec23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Volume volume-5e457aec-c862-49f0-874b-f1ea0c782c93 (5e457aec-c862-49f0-874b-f1ea0c782c93): created successfully
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d062d6-73a0-4764-905d-57732beeec23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Flow 'volume_create_manager' (843ffd7a-c391-4c76-92b2-90b03a1fedaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-449b35dc-28cf-4e13-83cf-92a9d9ae02dc tempest-VolumesTransfersV357Test-1936854189 None] Created volume successfully.
Apr 29 09:11:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4216aae8-a617-4d75-92a1-03d18219d6cd tempest-VolumesTransfersV357Test-97500868 None] Transfer volume completed successfully.
Apr 29 09:11:46 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e 1073741824" returned: 0 in 0.862s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:46 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e
Apr 29 09:11:46 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:47 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e" returned: 0 in 0.613s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.670s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08055b9-ee21-442a-8597-e3eb30eb775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80817726-3307-478b-b975-0f405efcd52e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cd167d-3d7d-4ab2-9f1f-0560fd6324fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af1cec-b643-4677-b9c5-ada7f7db9586]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:47 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Volume volume-80817726-3307-478b-b975-0f405efcd52e (80817726-3307-478b-b975-0f405efcd52e): created successfully
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cd167d-3d7d-4ab2-9f1f-0560fd6324fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Flow 'volume_create_manager' (4bcead48-0feb-4a80-be1f-d1956a0e6d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d91993df-f3ef-4819-8958-343a33b8af83 tempest-VolumesTransfersTest-1891171689 None] Created volume successfully.
Apr 29 09:11:47 devstack sudo[89421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:11:47 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Acquiring lock "cinder-5e457aec-c862-49f0-874b-f1ea0c782c93-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-5e457aec-c862-49f0-874b-f1ea0c782c93-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Acquiring lock "cinder-quobyte-5e457aec-c862-49f0-874b-f1ea0c782c93" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-quobyte-5e457aec-c862-49f0-874b-f1ea0c782c93" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d47cf97-ee20-446a-aae3-ecd6a1101a12]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:47 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93
Apr 29 09:11:47 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:48 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.812s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ad2ec9-372d-4669-bcbd-1c15d7c38b45]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:48 devstack sudo[89429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:11:48 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-36939d0f-8c3c-4349-84d9-bbe67d4f4fe7 tempest-VolumesTransfersTest-1691705979 None] Transfer volume completed successfully.
Apr 29 09:11:48 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93" returned: 0 in 0.786s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:48 devstack sudo[89434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93
Apr 29 09:11:48 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:48 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.799s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:48 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img
Apr 29 09:11:48 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:49 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5e457aec-c862-49f0-874b-f1ea0c782c93" returned: 0 in 0.656s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-quobyte-5e457aec-c862-49f0-874b-f1ea0c782c93" released by "delete_volume" :: held 1.491s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Created reservations ['43c9e135-cb7a-4e34-8aa9-ebe035f810b8', 'bf0de43f-2772-4abe-9d7b-21f74cc4d4fa', 'b790dd0a-32b1-44a6-9866-8762bc626262', 'b28e4268-ea13-418c-81c9-6fef88a7c0b7'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:49 devstack sudo[89442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:49 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Acquiring lock "cinder-80817726-3307-478b-b975-0f405efcd52e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-80817726-3307-478b-b975-0f405efcd52e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Acquiring lock "cinder-quobyte-80817726-3307-478b-b975-0f405efcd52e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-quobyte-80817726-3307-478b-b975-0f405efcd52e" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac08e21b-96c6-4515-8bbc-61c8fd476af5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:49 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e
Apr 29 09:11:49 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:50 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.713s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Deleted volume successfully.
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-464b3620-645e-4b51-96d3-0a609828dfa6 tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-5e457aec-c862-49f0-874b-f1ea0c782c93-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Flow 'volume_create_manager' (60f4f926-153b-4620-8ac2-3df2732bc690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd50a71a-21f8-44b4-b2c6-28f13756e5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd50a71a-21f8-44b4-b2c6-28f13756e5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-142428192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb9b1ee-77f8-49fd-af55-5a263969c191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede3078db5ad4e0abfb74a49b1d1c614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:51Z,use_quota=True,user_id='d2ee93cb9fd34d59929b794f8c97a359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3f027c-20ec-455b-a478-4374e74f7447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca3f027c-20ec-455b-a478-4374e74f7447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced29f65-ed7c-4d94-b4ab-455a572225d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced29f65-ed7c-4d94-b4ab-455a572225d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb9b1ee-77f8-49fd-af55-5a263969c191', 'volume_name': 'volume-eeb9b1ee-77f8-49fd-af55-5a263969c191', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75889afe-eb61-42fa-bcba-897a293817a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75889afe-eb61-42fa-bcba-897a293817a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd7baef-e3a0-47b3-ba91-481ac0ffc674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Volume eeb9b1ee-77f8-49fd-af55-5a263969c191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb9b1ee-77f8-49fd-af55-5a263969c191', 'volume_size': 1}
Apr 29 09:11:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:52 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e" returned: 0 in 2.599s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:52 devstack sudo[89463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e
Apr 29 09:11:52 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:53 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-80817726-3307-478b-b975-0f405efcd52e" returned: 0 in 1.209s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-quobyte-80817726-3307-478b-b975-0f405efcd52e" released by "delete_volume" :: held 3.868s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Created reservations ['b9451804-954b-441b-ac88-f6dc4ea31d26', '3631a649-4bc7-4117-ad88-56f297e056ec', 'cb8a90a7-34f6-42b9-a668-1f275daf7e75', 'f4fafc52-ecdf-4567-bfa4-bd1b8f104330'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:53 devstack sudo[89466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:53 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:54 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img" returned: 0 in 5.217s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cc7918-769e-4e53-9913-df0e8a7e5d4b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:54 devstack sudo[89469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:11:54 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:54 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.942s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Flow 'volume_create_manager' (e36fc39a-0faf-4204-bd08-c2a2ee974da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52f0a2d-e57a-4af1-91fe-81e55cfc5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Deleted volume successfully.
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52f0a2d-e57a-4af1-91fe-81e55cfc5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1900259487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94262bef-0a85-4d6b-bd57-58b165ae1d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75f73f2aef4db3850fcf4717fce520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:54Z,use_quota=True,user_id='14ad3aa79b084cea9fb0787d8fe1325f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b9f16-ce3c-48ac-9b04-fe2898a11153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971b9f16-ce3c-48ac-9b04-fe2898a11153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0759c9-2a0f-4ac4-b953-447f816e28f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de0759c9-2a0f-4ac4-b953-447f816e28f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94262bef-0a85-4d6b-bd57-58b165ae1d9a', 'volume_name': 'volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301962ea-2bbf-4f1c-a75c-cbf45decc20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301962ea-2bbf-4f1c-a75c-cbf45decc20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d306f05-4690-4826-8cb0-b75d1784c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:11:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Volume 94262bef-0a85-4d6b-bd57-58b165ae1d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a', 'volume_size': 1}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-69c8aa0d-575c-4efc-b8a6-32d2038d6949 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-80817726-3307-478b-b975-0f405efcd52e-delete_volume" released by "delete_volume" :: held 5.281s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:11:55 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.913s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:55 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:11:55 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Converted 1024.00 MB image at 196.17 MB/s
Apr 29 09:11:55 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] ee769759-84c7-462e-a41c-3d40a360d0c3 was raw, converting to qcow2 {{(pid=83863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 29 09:11:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7550752-d149-4c0b-8c86-c7cd1eb72160]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:55 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img
Apr 29 09:11:55 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:55 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img" returned: 0 in 0.693s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:55 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img
Apr 29 09:11:55 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:56 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img" returned: 1 in 0.665s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:11:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img /opt/stack/data/cinder/conversion/vol_upload_b8rzj9y1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:56 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img /opt/stack/data/cinder/conversion/vol_upload_b8rzj9y1
Apr 29 09:11:56 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:57 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img /opt/stack/data/cinder/conversion/vol_upload_b8rzj9y1" returned: 0 in 0.577s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:57 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Image conversion details: src /opt/stack/data/cinder/conversion/93b53c1c-25c8-4020-8e02-0c8a1076c3c2.temp_image.ee769759-84c7-462e-a41c-3d40a360d0c3rn63mk3e.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_b8rzj9y1 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:11:57 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 29 09:11:57 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f09386-5d26-4a97-ae9d-0bbe5c88beec]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:11:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_b8rzj9y1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:57 devstack sudo[89489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_b8rzj9y1
Apr 29 09:11:57 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:57 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_b8rzj9y1" returned: 0 in 0.679s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:59 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:11:59 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.090s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Uploaded volume to glance image-id: ee769759-84c7-462e-a41c-3d40a360d0c3. {{(pid=83863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.257s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1694699829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bab3126-c055-4366-a56a-8ae358354a10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ca54db966cd46b7a252696511c3e4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:45Z,use_quota=True,user_id='b8196df1bc2c4b72b7abe359970b99e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Creating volume 9bab3126-c055-4366-a56a-8ae358354a10 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:11:59 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:11:59 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10 1073741824
Apr 29 09:11:59 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:11:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8e867202-ce5d-49fa-906f-700cb62bc9be tempest-VolumesActionsTest-1973512944 None] Copy volume to image completed successfully.
Apr 29 09:11:59 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.605s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:11:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:00 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10 1073741824" returned: 0 in 0.799s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:00 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10
Apr 29 09:12:00 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:00 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10" returned: 0 in 0.644s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.290s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-142428192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb9b1ee-77f8-49fd-af55-5a263969c191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede3078db5ad4e0abfb74a49b1d1c614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:51Z,use_quota=True,user_id='d2ee93cb9fd34d59929b794f8c97a359',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Creating volume eeb9b1ee-77f8-49fd-af55-5a263969c191 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34bf706-8ab9-48da-a224-51415c60a8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bab3126-c055-4366-a56a-8ae358354a10', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:00 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191 1073741824
Apr 29 09:12:00 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ded138-91e5-446c-b6ef-12353d8596ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Volume volume-9bab3126-c055-4366-a56a-8ae358354a10 (9bab3126-c055-4366-a56a-8ae358354a10): created successfully
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ded138-91e5-446c-b6ef-12353d8596ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Flow 'volume_create_manager' (30f05a8f-7992-4cb0-a7eb-371756f308f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-66f1c6ac-2bf3-4a01-9772-719836ca72e5 tempest-VolumesTestJSON-791427542 None] Created volume successfully.
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Acquiring lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Acquiring lock "cinder-quobyte-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Lock "cinder-quobyte-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f09088-39c3-49aa-b7fb-5cff65c6160a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:01 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:12:01 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:01 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191 1073741824" returned: 0 in 0.988s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:01 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191
Apr 29 09:12:01 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:02 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.867s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:02 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2
Apr 29 09:12:02 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Acquiring lock "cinder-9bab3126-c055-4366-a56a-8ae358354a10-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Lock "cinder-9bab3126-c055-4366-a56a-8ae358354a10-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Acquiring lock "cinder-quobyte-9bab3126-c055-4366-a56a-8ae358354a10" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Lock "cinder-quobyte-9bab3126-c055-4366-a56a-8ae358354a10" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e78f1c-a9b9-4f71-b1be-7b7102cd88fa]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:02 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.966s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1900259487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94262bef-0a85-4d6b-bd57-58b165ae1d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75f73f2aef4db3850fcf4717fce520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:11:54Z,use_quota=True,user_id='14ad3aa79b084cea9fb0787d8fe1325f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Creating volume 94262bef-0a85-4d6b-bd57-58b165ae1d9a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:02 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:02 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a 1073741824
Apr 29 09:12:02 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd7baef-e3a0-47b3-ba91-481ac0ffc674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb9b1ee-77f8-49fd-af55-5a263969c191', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f01f9c9-6053-4b3d-822e-31936bd6da1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Volume volume-eeb9b1ee-77f8-49fd-af55-5a263969c191 (eeb9b1ee-77f8-49fd-af55-5a263969c191): created successfully
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f01f9c9-6053-4b3d-822e-31936bd6da1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Flow 'volume_create_manager' (60f4f926-153b-4620-8ac2-3df2732bc690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:02 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10
Apr 29 09:12:02 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-314c93a2-ee5b-4859-96d7-09a375b1169f tempest-VolumesTransfersV357Test-1936854189 None] Created volume successfully.
Apr 29 09:12:02 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" returned: 0 in 0.758s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Lock "cinder-quobyte-93b53c1c-25c8-4020-8e02-0c8a1076c3c2" released by "delete_volume" :: held 1.684s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:02 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Created reservations ['8161b3c5-0664-41d7-bfc7-22caf7b292e5', 'ef0a6d7d-e126-41d0-84b5-e5bf81d4eb3d', 'ad9ba7fc-f333-4371-8bf0-2e9d167de9da', 'c9157e86-2ed2-4071-a48a-cd55df385f63'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:03 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:03 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Acquiring lock "cinder-eeb9b1ee-77f8-49fd-af55-5a263969c191-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-eeb9b1ee-77f8-49fd-af55-5a263969c191-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Acquiring lock "cinder-quobyte-eeb9b1ee-77f8-49fd-af55-5a263969c191" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-quobyte-eeb9b1ee-77f8-49fd-af55-5a263969c191" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dec2d63-861b-45cf-a841-525f027ae8d5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:03 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191
Apr 29 09:12:03 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:03 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10" returned: 0 in 1.159s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:03 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10
Apr 29 09:12:03 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:03 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a 1073741824" returned: 0 in 1.187s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:03 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.834s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Deleted volume successfully.
Apr 29 09:12:03 devstack sudo[89540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a
Apr 29 09:12:03 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-037d21b4-1145-42b7-9586-deff7a5acc1b tempest-VolumesActionsTest-1973512944 None] Lock "cinder-93b53c1c-25c8-4020-8e02-0c8a1076c3c2-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:04 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191" returned: 0 in 0.962s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:04 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191
Apr 29 09:12:04 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:04 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bab3126-c055-4366-a56a-8ae358354a10" returned: 0 in 0.776s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Lock "cinder-quobyte-9bab3126-c055-4366-a56a-8ae358354a10" released by "delete_volume" :: held 1.994s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:04 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a" returned: 0 in 0.711s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Created reservations ['a94ebe89-2b40-4ae8-9638-0bd250164eb7', '941d0cec-bf9e-4fec-8fef-a62e7646e990', 'b31e2915-90a7-41ed-bd07-bcb83d0e01fd', '8a9ee178-6108-4fb8-a44f-116dc2237c8a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d306f05-4690-4826-8cb0-b75d1784c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0745ab-fa9d-43da-a19d-3c680f5ebc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Volume volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a (94262bef-0a85-4d6b-bd57-58b165ae1d9a): created successfully
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0745ab-fa9d-43da-a19d-3c680f5ebc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Flow 'volume_create_manager' (e36fc39a-0faf-4204-bd08-c2a2ee974da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-dca59f20-e293-4bf3-a86d-9f8569f623e1 tempest-VolumesTransfersTest-1891171689 None] Created volume successfully.
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:04 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:04 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Acquiring lock "cinder-aa8a2809-35c4-4c40-8ee7-249df65efce8-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Lock "cinder-aa8a2809-35c4-4c40-8ee7-249df65efce8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Acquiring lock "cinder-quobyte-aa8a2809-35c4-4c40-8ee7-249df65efce8" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Lock "cinder-quobyte-aa8a2809-35c4-4c40-8ee7-249df65efce8" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cabd81a-7631-4043-a20d-375d04a55372]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:05 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8
Apr 29 09:12:05 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:05 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eeb9b1ee-77f8-49fd-af55-5a263969c191" returned: 0 in 0.716s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-quobyte-eeb9b1ee-77f8-49fd-af55-5a263969c191" released by "delete_volume" :: held 1.761s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Created reservations ['47574599-8392-4d6e-a8fe-fa3a0bfb9589', 'cdb60b4d-3870-4899-9c8e-afa8456a9a80', 'c3599d58-bfde-4336-9b7d-878a1860951e', 'd4930b67-b362-466a-a77e-ef13b4be04ca'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:05 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:05 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:05 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.031s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Deleted volume successfully.
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Acquiring lock "cinder-94262bef-0a85-4d6b-bd57-58b165ae1d9a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f0addbc-4541-4e38-9fab-05a723f6408f tempest-VolumesTestJSON-791427542 None] Lock "cinder-9bab3126-c055-4366-a56a-8ae358354a10-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-94262bef-0a85-4d6b-bd57-58b165ae1d9a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Acquiring lock "cinder-quobyte-94262bef-0a85-4d6b-bd57-58b165ae1d9a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-quobyte-94262bef-0a85-4d6b-bd57-58b165ae1d9a" acquired by "delete_volume" :: waited 0.036s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1991ee5-8eec-4ae0-a822-ea91298d8cb4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:06 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8" returned: 0 in 1.221s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:06 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a
Apr 29 09:12:06 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:06 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8
Apr 29 09:12:06 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:06 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.946s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:06 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:06 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Deleted volume successfully.
Apr 29 09:12:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3b6bb0f1-94d3-4683-9285-6e989dde11df tempest-VolumesTransfersV357Test-1821387974 None] Lock "cinder-eeb9b1ee-77f8-49fd-af55-5a263969c191-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:06 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-aa8a2809-35c4-4c40-8ee7-249df65efce8" returned: 0 in 0.850s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Lock "cinder-quobyte-aa8a2809-35c4-4c40-8ee7-249df65efce8" released by "delete_volume" :: held 2.128s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:07 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a" returned: 0 in 1.082s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:07 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a
Apr 29 09:12:07 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Created reservations ['a4e66510-fde9-41da-8bf7-8de08b8b1dd8', '0de5e2ef-2ac9-4552-aee3-b872a1d39f81', '3752da65-2ef1-4f94-8dcd-f6d766814d71', '5d1f1ca1-42cc-4d87-b9e8-c1d5ada7c034'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:07 devstack sudo[89577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:07 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:07 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-94262bef-0a85-4d6b-bd57-58b165ae1d9a" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-quobyte-94262bef-0a85-4d6b-bd57-58b165ae1d9a" released by "delete_volume" :: held 1.922s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Created reservations ['985eaa88-608d-4718-95be-08c3cfdf9d6b', '896ab61e-c1cb-4c00-a2bb-6333d91cf03d', 'e9ff97fb-4411-4ada-b46c-d1d245d62772', '1d6ee382-dd8f-4cf2-8d08-f56ff48827cb'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:08 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:08 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:08 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.901s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Deleted volume successfully.
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a80f24e-e4f0-44d3-a5c0-fd672ea4d37c tempest-VolumesTestJSON-791427542 None] Lock "cinder-aa8a2809-35c4-4c40-8ee7-249df65efce8-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Acquiring lock "cinder-26245a74-1e57-4429-bbe3-eee17b1af15a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Lock "cinder-26245a74-1e57-4429-bbe3-eee17b1af15a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Acquiring lock "cinder-quobyte-26245a74-1e57-4429-bbe3-eee17b1af15a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Lock "cinder-quobyte-26245a74-1e57-4429-bbe3-eee17b1af15a" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf2e0f5-4172-40a5-adc5-0f8a58b9cda8]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:08 devstack sudo[89584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a
Apr 29 09:12:08 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:08 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.926s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Deleted volume successfully.
Apr 29 09:12:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f77cb4ba-de88-4ce9-90cc-4df3b1365811 tempest-VolumesTransfersTest-1705340640 None] Lock "cinder-94262bef-0a85-4d6b-bd57-58b165ae1d9a-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:09 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a" returned: 0 in 1.064s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:09 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a
Apr 29 09:12:09 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:10 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26245a74-1e57-4429-bbe3-eee17b1af15a" returned: 0 in 0.808s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Lock "cinder-quobyte-26245a74-1e57-4429-bbe3-eee17b1af15a" released by "delete_volume" :: held 1.940s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Created reservations ['34753034-df62-4ec4-a46b-d0faf390ffe1', '47e2a015-029b-499f-b7e7-5ff9ac102a00', 'edadbf65-5976-4845-9bf4-dda6ef1975c5', '24fb65f2-7c91-480e-af86-caa90be8c703'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:10 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:10 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:11 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.901s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:11 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:11 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Deleted volume successfully.
Apr 29 09:12:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-95306ebd-4eb3-4c14-a6eb-00666b619043 tempest-VolumesTestJSON-791427542 None] Lock "cinder-26245a74-1e57-4429-bbe3-eee17b1af15a-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (d84bc62d-4de4-4ff3-b9a4-622cbb019fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaecded-09f9-47a1-b381-b0f451d64b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaecded-09f9-47a1-b381-b0f451d64b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342473318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:14Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb1dba9-aa03-4a65-9806-d660c048d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb1dba9-aa03-4a65-9806-d660c048d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d58f878-8844-4dd7-b3fa-63dbcb34aed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d58f878-8844-4dd7-b3fa-63dbcb34aed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6', 'volume_name': 'volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58dd7dce-18ad-49de-918d-64cec0ec7c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58dd7dce-18ad-49de-918d-64cec0ec7c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60546f37-2238-4ba9-936e-89fd9ba81771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Volume ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6', 'volume_size': 1}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1342473318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:14Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Creating volume ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:12:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:13 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 1073741824
Apr 29 09:12:13 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:14 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 1073741824" returned: 0 in 1.019s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:14 devstack sudo[89604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6
Apr 29 09:12:14 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:15 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6" returned: 0 in 0.792s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60546f37-2238-4ba9-936e-89fd9ba81771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d26b23-2b80-44d8-8594-875f25999596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:15 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Volume volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 (ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6): created successfully
Apr 29 09:12:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d26b23-2b80-44d8-8594-875f25999596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (d84bc62d-4de4-4ff3-b9a4-622cbb019fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d556bcee-c752-4781-bc44-faceff1a9db3 tempest-VolumesGetTest-1069336996 None] Created volume successfully.
Apr 29 09:12:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2d5803e8-317e-4607-aa12-c7ed370fc36a tempest-GroupSnapshotsTest-1882339353 None] Group tempest-GroupSnapshotsTest-Group-316545755: creating
Apr 29 09:12:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2d5803e8-317e-4607-aa12-c7ed370fc36a tempest-GroupSnapshotsTest-1882339353 None] Group tempest-GroupSnapshotsTest-Group-316545755: created successfully
Apr 29 09:12:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2d5803e8-317e-4607-aa12-c7ed370fc36a tempest-GroupSnapshotsTest-1882339353 None] Create group completed successfully.
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (966c0bed-d9bc-44d5-91aa-10da85f22ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f54a670-d71f-4926-82ba-873b69bf5428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f54a670-d71f-4926-82ba-873b69bf5428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1469453541',display_name='tempest-VolumesGetTest-Volume-1277691212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c64fde7-0784-456f-923c-4d5344dda52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:18Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745815b6-6cf2-497c-ae1d-cafe94d761bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745815b6-6cf2-497c-ae1d-cafe94d761bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c161802-d735-4ac8-83a3-176bde911d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c161802-d735-4ac8-83a3-176bde911d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c64fde7-0784-456f-923c-4d5344dda52d', 'volume_name': 'volume-2c64fde7-0784-456f-923c-4d5344dda52d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa59da-42df-4a34-9b12-99a3057e9203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa59da-42df-4a34-9b12-99a3057e9203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1219e5-cf74-4f2c-99e6-d4114a119d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Volume 2c64fde7-0784-456f-923c-4d5344dda52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c64fde7-0784-456f-923c-4d5344dda52d', 'volume_size': 1}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1469453541',display_name='tempest-VolumesGetTest-Volume-1277691212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c64fde7-0784-456f-923c-4d5344dda52d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:18Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Creating volume 2c64fde7-0784-456f-923c-4d5344dda52d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:17 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:12:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:18 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d 1073741824
Apr 29 09:12:18 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (bd951725-7cec-4d09-ae0a-6c37a05a6497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685512a4-3f96-49f3-972d-8a45d4aaa623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685512a4-3f96-49f3-972d-8a45d4aaa623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-140751454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2323249-948c-41be-b31c-eac407c43947,host='devstack@QuobyteHD#QuobyteHD',id=776612aa-f0bc-4f83-a060-0b8bb7d66549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:18Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcddd559-db0e-43e6-9737-4f5cdd8860f4),volume_type_id=bcddd559-db0e-43e6-9737-4f5cdd8860f4)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c69977-af64-4ce9-82f2-40e23bf2d790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c69977-af64-4ce9-82f2-40e23bf2d790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedfb1e0-45fa-41c5-88f8-cf6e056a0451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedfb1e0-45fa-41c5-88f8-cf6e056a0451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776612aa-f0bc-4f83-a060-0b8bb7d66549', 'volume_name': 'volume-776612aa-f0bc-4f83-a060-0b8bb7d66549', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22abdc3-ceac-4237-98e6-3787aeb4e3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22abdc3-ceac-4237-98e6-3787aeb4e3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93f136f-63c6-4835-85d4-c8f041c5335f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Volume 776612aa-f0bc-4f83-a060-0b8bb7d66549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776612aa-f0bc-4f83-a060-0b8bb7d66549', 'volume_size': 1}
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:18 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d 1073741824" returned: 0 in 0.992s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:19 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d
Apr 29 09:12:19 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:19 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d" returned: 0 in 0.708s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c2323249-948c-41be-b31c-eac407c43947,created_at=2026-04-29T07:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-140751454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2323249-948c-41be-b31c-eac407c43947,host='devstack@QuobyteHD#QuobyteHD',id=776612aa-f0bc-4f83-a060-0b8bb7d66549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:18Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcddd559-db0e-43e6-9737-4f5cdd8860f4),volume_type_id=bcddd559-db0e-43e6-9737-4f5cdd8860f4)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Creating volume 776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:19 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1219e5-cf74-4f2c-99e6-d4114a119d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c64fde7-0784-456f-923c-4d5344dda52d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc121b3-b368-4813-ae11-981c3c4c2f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:19 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 1073741824
Apr 29 09:12:19 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Volume volume-2c64fde7-0784-456f-923c-4d5344dda52d (2c64fde7-0784-456f-923c-4d5344dda52d): created successfully
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc121b3-b368-4813-ae11-981c3c4c2f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (966c0bed-d9bc-44d5-91aa-10da85f22ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fcbfd29b-8eec-469b-909f-081a03b3a6a3 tempest-VolumesGetTest-1069336996 None] Created volume successfully.
Apr 29 09:12:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-2c64fde7-0784-456f-923c-4d5344dda52d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Lock "cinder-2c64fde7-0784-456f-923c-4d5344dda52d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-2c64fde7-0784-456f-923c-4d5344dda52d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-2c64fde7-0784-456f-923c-4d5344dda52d" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccfcc0f-835f-4190-ba9e-d035527031c7]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:20 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d
Apr 29 09:12:20 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:20 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 1073741824" returned: 0 in 1.199s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:21 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549
Apr 29 09:12:21 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:21 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d" returned: 0 in 0.813s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:21 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d
Apr 29 09:12:21 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:21 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549" returned: 0 in 0.786s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93f136f-63c6-4835-85d4-c8f041c5335f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776612aa-f0bc-4f83-a060-0b8bb7d66549', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93488e80-452b-4878-8a6b-10afcdf839e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Volume volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 (776612aa-f0bc-4f83-a060-0b8bb7d66549): created successfully
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93488e80-452b-4878-8a6b-10afcdf839e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (bd951725-7cec-4d09-ae0a-6c37a05a6497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7700c9f6-2ebf-4804-a824-9fbdfce2e4a0 tempest-GroupSnapshotsTest-1882339353 None] Created volume successfully.
Apr 29 09:12:22 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2c64fde7-0784-456f-923c-4d5344dda52d" returned: 0 in 0.868s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-2c64fde7-0784-456f-923c-4d5344dda52d" released by "delete_volume" :: held 1.764s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Created reservations ['9132ea49-d815-49cf-ae33-9fbbc496a919', 'aad79aa1-f950-4d0b-80e2-7f2bdecc8359', '6a3c7e78-3d6d-4ebb-8a4c-694896c06ee0', '72f333c6-930c-4e20-962b-98e3cca8bfec'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:22 devstack sudo[89669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:22 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Lock "cinder-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6" acquired by "delete_volume" :: waited 0.059s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae36707-39f0-49d2-9a03-cf68890b9726]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] GroupSnapshot c292df8b-17a5-4c09-bab3-7a7dc989c376: creating.
Apr 29 09:12:23 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6
Apr 29 09:12:23 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:23 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.892s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Group snapshot c292df8b-17a5-4c09-bab3-7a7dc989c376: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 09:12:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Deleted volume successfully.
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Creating offline snapshot 5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 of volume 776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4d2d6dd6-1bd6-4b52-8569-957fce2abbcb tempest-VolumesGetTest-1069336996 None] Lock "cinder-2c64fde7-0784-456f-923c-4d5344dda52d-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b19697-d2f7-44af-86da-7ff0f9065c5c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:23 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549
Apr 29 09:12:23 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:24 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6" returned: 0 in 1.416s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:24 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6
Apr 29 09:12:24 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:24 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549" returned: 0 in 1.151s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:24 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 1G
Apr 29 09:12:24 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:25 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6" returned: 0 in 0.897s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6" released by "delete_volume" :: held 2.385s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Created reservations ['09265321-0ede-4804-b2d2-e38b03b4f641', '1c279287-0636-4f70-9c5d-cb8742f54e23', 'be64253a-c33a-4abc-be02-5710ae2374d7', '486cfa86-b9ad-467d-8dcd-d990250371a5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:25 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:25 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:25 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 1G" returned: 0 in 1.223s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:25 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00
Apr 29 09:12:25 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:26 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.920s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Deleted volume successfully.
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6cd499a7-134a-4683-bd90-3e82a1c038e7 tempest-VolumesGetTest-1069336996 None] Lock "cinder-ae1cf4a7-6d18-43f6-94cd-9c796fee4ff6-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:26 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" returned: 0 in 0.964s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:26 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:26 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00
Apr 29 09:12:26 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (ea332e54-1dc6-49da-81d6-a080fa28fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a27af6-30be-4b67-b8fe-6f6987ccc2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a27af6-30be-4b67-b8fe-6f6987ccc2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129150716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06844307-6752-43ee-ba02-06a2f662b4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:27Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed45625b-a324-400d-a9e1-e9d5d2ed0133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed45625b-a324-400d-a9e1-e9d5d2ed0133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbeb04c6-f4ab-438a-acad-c80a10bf1298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbeb04c6-f4ab-438a-acad-c80a10bf1298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06844307-6752-43ee-ba02-06a2f662b4db', 'volume_name': 'volume-06844307-6752-43ee-ba02-06a2f662b4db', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982f1c04-c763-43cd-aaba-0ca9977f8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982f1c04-c763-43cd-aaba-0ca9977f8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fc8be9-af59-465e-ad30-6b21b49e0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:26 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Volume 06844307-6752-43ee-ba02-06a2f662b4db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06844307-6752-43ee-ba02-06a2f662b4db', 'volume_size': 1}
Apr 29 09:12:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:27 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:27 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.info
Apr 29 09:12:27 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:28 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.info" returned: 0 in 0.623s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:28 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:28 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.info
Apr 29 09:12:28 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:28 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.info" returned: 0 in 0.697s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.588s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-129150716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06844307-6752-43ee-ba02-06a2f662b4db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:27Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Creating volume 06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:28 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:12:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:28 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db 1073741824
Apr 29 09:12:28 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-93ca7dfc-a6da-40e4-a615-f3064971598d tempest-GroupSnapshotsTest-1882339353 None] group_snapshot c292df8b-17a5-4c09-bab3-7a7dc989c376: created successfully
Apr 29 09:12:29 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db 1073741824" returned: 0 in 1.127s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:30 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db
Apr 29 09:12:30 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:30 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db" returned: 0 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fc8be9-af59-465e-ad30-6b21b49e0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06844307-6752-43ee-ba02-06a2f662b4db', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2f4979-9c99-4b37-a315-9d617385c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:30 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Volume volume-06844307-6752-43ee-ba02-06a2f662b4db (06844307-6752-43ee-ba02-06a2f662b4db): created successfully
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2f4979-9c99-4b37-a315-9d617385c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (ea332e54-1dc6-49da-81d6-a080fa28fdae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (52ba9f26-953f-4960-8805-4fa26c5ee44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc2b1cf-89d4-46f0-9e4b-cc5ad252e5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00-9bb628ec-d8cd-49fb-9b66-ce79575d912c" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7a257692-ca95-4084-9abc-90f6dd75ed50 tempest-VolumesGetTest-1069336996 None] Created volume successfully.
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc2b1cf-89d4-46f0-9e4b-cc5ad252e5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1517556713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9650bcc9-5fe0-434c-b034-7fa91fb15ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:31Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce197047-9da9-4299-871e-5f0866e867e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce197047-9da9-4299-871e-5f0866e867e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f1f799-120b-4130-9588-ad436c9bc23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f1f799-120b-4130-9588-ad436c9bc23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9650bcc9-5fe0-434c-b034-7fa91fb15ff2', 'volume_name': 'volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34f2df7-6db9-4db6-9987-f57058f65c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34f2df7-6db9-4db6-9987-f57058f65c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26510ea1-50cb-4d96-8b80-51f1a644862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:31 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume 9650bcc9-5fe0-434c-b034-7fa91fb15ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2', 'volume_size': 1}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00-9bb628ec-d8cd-49fb-9b66-ce79575d912c" acquired by "_create_volume_from_snapshot" :: waited 0.076s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Creating volume 9bb628ec-d8cd-49fb-9b66-ce79575d912c from snapshot 5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-9bb628ec-d8cd-49fb-9b66-ce79575d912c" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-9bb628ec-d8cd-49fb-9b66-ce79575d912c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] snapshot: 5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00, volume: 9bb628ec-d8cd-49fb-9b66-ce79575d912c,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[836058b9-0d6e-4d25-a4f4-39094aae5b71]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:31 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00
Apr 29 09:12:31 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (16e9a4db-bd94-499c-be65-73795524ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b0f17-ee23-48e2-8059-bcf9f92afd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23b0f17-ee23-48e2-8059-bcf9f92afd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-643875147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf50f67-d60c-4dd8-8c1d-2b5b8e78b606,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=06844307-6752-43ee-ba02-06a2f662b4db,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:31Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d699825f-783d-44b7-bde1-e228d8792bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d699825f-783d-44b7-bde1-e228d8792bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6047d46-53ce-416a-8504-a0e7ac8551f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6047d46-53ce-416a-8504-a0e7ac8551f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'daf50f67-d60c-4dd8-8c1d-2b5b8e78b606', 'volume_name': 'volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606', 'volume_size': 1, 'source_volid': '06844307-6752-43ee-ba02-06a2f662b4db', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0433e8dd-5b36-4182-9626-f2fecef3dc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0433e8dd-5b36-4182-9626-f2fecef3dc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27275a7c-65b7-4e0b-b3d0-9d4a5b4d16c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:31 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Volume daf50f67-d60c-4dd8-8c1d-2b5b8e78b606: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606', 'volume_size': 1, 'source_volid': '06844307-6752-43ee-ba02-06a2f662b4db', 'source_volstatus': 'available'}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:31 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" returned: 0 in 0.816s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-776612aa-f0bc-4f83-a060-0b8bb7d66549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b45427-6ff5-42f3-b285-5cf12dfef499]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:32 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549
Apr 29 09:12:32 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:32 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549" returned: 0 in 0.782s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:32 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:12:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:32 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c
Apr 29 09:12:32 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:38 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c" returned: 0 in 5.530s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:38 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f79d52-9b8c-4e1e-94b2-277f48f869fc]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:38 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549
Apr 29 09:12:38 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:39 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549" returned: 0 in 0.871s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:12:39 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Converted 1024.00 MB image at 185.12 MB/s
Apr 29 09:12:39 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:39 devstack sudo[89757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c
Apr 29 09:12:39 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:39 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-9bb628ec-d8cd-49fb-9b66-ce79575d912c" released by "_copy_volume_from_snapshot" :: held 8.730s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00-9bb628ec-d8cd-49fb-9b66-ce79575d912c" released by "_create_volume_from_snapshot" :: held 8.771s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.848s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.777s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1517556713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9650bcc9-5fe0-434c-b034-7fa91fb15ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:31Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Creating volume 9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:12:39 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=90,cinder:UPDATE=118,cinder:DELETE=10,cinder:INSERT=28 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:12:39 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 1073741824
Apr 29 09:12:39 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:39 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=112,cinder:SELECT=78,cinder:INSERT=23,cinder:DELETE=10 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:12:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a798af1a-33cb-4125-b60a-e92e87faa697 tempest-GroupSnapshotsTest-1882339353 None] Create group from source-snapshot-c292df8b-17a5-4c09-bab3-7a7dc989c376 completed successfully.
Apr 29 09:12:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-9bb628ec-d8cd-49fb-9b66-ce79575d912c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-9bb628ec-d8cd-49fb-9b66-ce79575d912c" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f15ce7f-a794-4418-8717-c51b9e4b71c5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:40 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 1073741824" returned: 0 in 0.966s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:40 devstack sudo[89767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2
Apr 29 09:12:40 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:40 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c
Apr 29 09:12:40 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:41 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" returned: 0 in 0.613s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.718s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:41 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Cloning volume 06844307-6752-43ee-ba02-06a2f662b4db to volume daf50f67-d60c-4dd8-8c1d-2b5b8e78b606
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26510ea1-50cb-4d96-8b80-51f1a644862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:41 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f001affc-f0eb-4956-b5cf-d24016b68cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c" returned: 0 in 0.721s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:41 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c
Apr 29 09:12:41 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Creating offline snapshot 1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 of volume 06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:12:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 (9650bcc9-5fe0-434c-b034-7fa91fb15ff2): created successfully
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f001affc-f0eb-4956-b5cf-d24016b68cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (52ba9f26-953f-4960-8805-4fa26c5ee44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeb15ef-527b-408e-95ee-00635323dfaa]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f475e220-86db-4e34-826b-3d32c87d4ad5 tempest-VolumesSnapshotTestJSON-1223369711 None] Created volume successfully.
Apr 29 09:12:41 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db
Apr 29 09:12:41 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:42 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9bb628ec-d8cd-49fb-9b66-ce79575d912c" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-9bb628ec-d8cd-49fb-9b66-ce79575d912c" released by "delete_volume" :: held 1.473s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['efd3c20f-8e22-4911-b3b5-f01a53c1efce'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:42 devstack cinder-volume[83863]: WARNING cinder.quota [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-990893437 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-990893437, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:12:42 devstack cinder-volume[83863]: WARNING cinder.quota [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-990893437 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-990893437, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['f4c6d7be-32aa-4171-8308-1db6d440d2e3', '04536615-0047-4b04-a469-10b488ab3c32', '201620a4-5e28-49e4-8aa3-453689fb0c19', 'fb8e56fb-6b16-47da-ac8d-d62f45a1e343'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:42 devstack sudo[89785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:42 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:42 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db" returned: 0 in 1.010s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:42 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 1G
Apr 29 09:12:42 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] group_snapshot c292df8b-17a5-4c09-bab3-7a7dc989c376: deleting
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] group_snapshot c292df8b-17a5-4c09-bab3-7a7dc989c376: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-776612aa-f0bc-4f83-a060-0b8bb7d66549" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-776612aa-f0bc-4f83-a060-0b8bb7d66549" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Deleting offline snapshot 5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 of volume 776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:12:43 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] snapshot_file for this snap is: volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.740s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-82665016-909d-46e7-8587-3e0d3a111d0d tempest-GroupSnapshotsTest-1882339353 None] Delete group completed successfully.
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[141adb54-1be8-41f9-8f13-5ad5f366d291]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Flow 'volume_create_manager' (53237dcf-c9e8-4556-9850-23ba41a12c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:43 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00
Apr 29 09:12:43 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031c3584-489d-4205-9016-d72b10fd8b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031c3584-489d-4205-9016-d72b10fd8b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-743235829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06807703-75d3-4a7a-b173-40e16dc837ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f151577c174598828ab1ae7e3f5e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:43Z,use_quota=True,user_id='75bd3d740dfc4c41b6ccfa7d500f6af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95592be5-5454-4d2e-b319-9077c2f3a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95592be5-5454-4d2e-b319-9077c2f3a216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39760e7-5533-492b-8323-ce74d5ae22c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39760e7-5533-492b-8323-ce74d5ae22c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06807703-75d3-4a7a-b173-40e16dc837ea', 'volume_name': 'volume-06807703-75d3-4a7a-b173-40e16dc837ea', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e0538c-7d0d-4573-b202-846785c38598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e0538c-7d0d-4573-b202-846785c38598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:43 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6629c952-2098-4450-8a62-11a757e0f98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:43 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Volume 06807703-75d3-4a7a-b173-40e16dc837ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06807703-75d3-4a7a-b173-40e16dc837ea', 'volume_size': 1}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 1G" returned: 0 in 0.934s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06844307-6752-43ee-ba02-06a2f662b4db -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:43 devstack sudo[89797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06844307-6752-43ee-ba02-06a2f662b4db -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5
Apr 29 09:12:43 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:44 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-776612aa-f0bc-4f83-a060-0b8bb7d66549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9011fe-c295-4ade-a610-33430f77e21b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:44 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06844307-6752-43ee-ba02-06a2f662b4db -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:44 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 is being set with open permissions: ugo+rw
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:44 devstack sudo[89806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5
Apr 29 09:12:44 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:44 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549
Apr 29 09:12:44 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:44 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" returned: 0 in 0.609s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:44 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549" returned: 0 in 0.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:44 devstack sudo[89814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.info
Apr 29 09:12:44 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:44 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00
Apr 29 09:12:44 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:45 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.info" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:45 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.info is being set with open permissions: ugo+rw
Apr 29 09:12:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:45 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.info
Apr 29 09:12:45 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:45 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:45 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00
Apr 29 09:12:45 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:45 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.info" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] snapshot: 1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5, volume: daf50f67-d60c-4dd8-8c1d-2b5b8e78b606,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[86156a28-29fc-4f9b-a8ff-0c29437d7632]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:46 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549.5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" returned: 0 in 0.655s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-5a9cf2ed-d9da-4da5-8a6c-1dd4a65adb00" released by "_delete_snapshot" :: held 2.992s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-776612aa-f0bc-4f83-a060-0b8bb7d66549" released by "delete_snapshot" :: held 3.052s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:46 devstack sudo[89828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5
Apr 29 09:12:46 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:46 devstack cinder-volume[83863]: WARNING cinder.quota [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-990893437 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-990893437, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['59960a5d-4926-4616-85a3-22c9decabfc0', '37f3594a-57dd-43d4-b64a-2567ffae32f3', 'f007165e-92e3-4e8b-8491-564887402204', '0c6ddc2e-c2b5-4e5c-8393-8fbf5e149295'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0550d593-3cf2-4222-aab8-884dc4be523a tempest-GroupSnapshotsTest-1882339353 None] group_snapshot c292df8b-17a5-4c09-bab3-7a7dc989c376: deleted successfully
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-776612aa-f0bc-4f83-a060-0b8bb7d66549" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-776612aa-f0bc-4f83-a060-0b8bb7d66549" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e592c9-0d4e-4240-8a2e-fb8cab12c12e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:46 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549
Apr 29 09:12:46 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:46 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" returned: 0 in 0.856s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06844307-6752-43ee-ba02-06a2f662b4db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b18595-d545-4987-aeae-336159d7885e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:47 devstack sudo[89835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db
Apr 29 09:12:47 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:47 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549" returned: 0 in 0.758s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:47 devstack sudo[89840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549
Apr 29 09:12:47 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:47 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db" returned: 0 in 0.792s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:47 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:12:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:47 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606
Apr 29 09:12:47 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:48 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-776612aa-f0bc-4f83-a060-0b8bb7d66549" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-776612aa-f0bc-4f83-a060-0b8bb7d66549" released by "delete_volume" :: held 1.449s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['ed7ddcad-26a9-4b44-8ec7-f7fe5b1a82b1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:48 devstack cinder-volume[83863]: WARNING cinder.db.sqlalchemy.api [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-990893437']
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['4bf207a2-def6-47de-a870-7b54f5b01281', '00f13eee-bde1-4946-bda7-04f8631dd4d2', 'e5808cd3-c9ae-4ba5-8ef8-d268fbb21434', 'ff1725fb-06d3-4154-9783-5d3faa0cc713'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:48 devstack sudo[89851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:48 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:49 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.296s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:49 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:12:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-50a49459-c9c6-4f93-84bb-4fc332295ad7 tempest-GroupSnapshotsTest-1882339353 None] Delete group completed successfully.
Apr 29 09:12:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-25c1efa5-9507-4f77-997b-e170ea04ad67 tempest-GroupSnapshotsTest-1882339353 None] Group tempest-GroupSnapshotsTest-Group-2028038722: creating
Apr 29 09:12:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-25c1efa5-9507-4f77-997b-e170ea04ad67 tempest-GroupSnapshotsTest-1882339353 None] Group tempest-GroupSnapshotsTest-Group-2028038722: created successfully
Apr 29 09:12:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-25c1efa5-9507-4f77-997b-e170ea04ad67 tempest-GroupSnapshotsTest-1882339353 None] Create group completed successfully.
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (a497e31a-ac5e-48ac-ab55-21c0763f431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c76940-db8b-48fd-881d-f95efce38fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c76940-db8b-48fd-881d-f95efce38fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113894842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e377c1bd-ee48-4f16-bf8a-1309b053120e,host='devstack@QuobyteHD#QuobyteHD',id=3bb74a5d-c42c-4716-8873-ce621a3c6164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:52Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(814a879d-a01d-4197-850a-77e6d0ae298a),volume_type_id=814a879d-a01d-4197-850a-77e6d0ae298a)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b840c0-7d90-4ec0-a2e7-8088f7ca07c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b840c0-7d90-4ec0-a2e7-8088f7ca07c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb6cc47-0ca7-45c1-8d93-4187e90bf2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb6cc47-0ca7-45c1-8d93-4187e90bf2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bb74a5d-c42c-4716-8873-ce621a3c6164', 'volume_name': 'volume-3bb74a5d-c42c-4716-8873-ce621a3c6164', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44887b7-4106-485b-a571-0583111d19cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44887b7-4106-485b-a571-0583111d19cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b498ab9-79d5-4824-82f1-9d02ce8b26b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Volume 3bb74a5d-c42c-4716-8873-ce621a3c6164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bb74a5d-c42c-4716-8873-ce621a3c6164', 'volume_size': 1}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:52 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" returned: 0 in 4.804s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[898b6568-3b82-4ae5-912e-d53267f9c888]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:52 devstack sudo[89862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db
Apr 29 09:12:52 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:53 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db" returned: 0 in 0.850s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:53 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:12:53 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Converted 1024.00 MB image at 213.12 MB/s
Apr 29 09:12:53 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 is being set with open permissions: ugo+rw
Apr 29 09:12:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:53 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606
Apr 29 09:12:53 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:53 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" returned: 0 in 0.566s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" released by "_copy_volume_from_snapshot" :: held 7.961s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Deleting offline snapshot 1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 of volume 06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] snapshot_file for this snap is: volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e98d7-4e7f-4947-8d16-2f38eaa3e173]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:54 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5
Apr 29 09:12:54 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:54 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06844307-6752-43ee-ba02-06a2f662b4db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c625e1d-8702-4fc1-b29e-ed6b8199c8e5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:54 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db
Apr 29 09:12:54 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:55 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db" returned: 0 in 0.770s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:55 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5
Apr 29 09:12:55 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:56 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" returned: 0 in 0.641s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:56 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5
Apr 29 09:12:56 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:56 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db.1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" returned: 0 in 0.555s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-1f61b86f-5a5a-492f-a3d2-f10c8b3cb0f5" released by "_delete_snapshot" :: held 2.746s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.389s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.480s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27275a7c-65b7-4e0b-b3d0-9d4a5b4d16c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606', 'volume_size': 1, 'source_volid': '06844307-6752-43ee-ba02-06a2f662b4db', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db35c4-7ae3-4faa-a73e-19c93d1ac1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Creating offline snapshot a9993d89-5561-475e-b27f-9ff2805edefb of volume 9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:12:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Volume volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 (daf50f67-d60c-4dd8-8c1d-2b5b8e78b606): created successfully
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51db35c4-7ae3-4faa-a73e-19c93d1ac1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (16e9a4db-bd94-499c-be65-73795524ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f18bad-23d1-45fd-a2dc-35ae28e828ea]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:12:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:56 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-edc4b406-9f9e-480b-8b3e-6acb0577f32b tempest-VolumesGetTest-1069336996 None] Created volume successfully.
Apr 29 09:12:56 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2
Apr 29 09:12:56 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:57 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" returned: 0 in 0.687s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:57 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb 1G
Apr 29 09:12:57 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:58 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb 1G" returned: 0 in 0.740s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:58 devstack sudo[89900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb
Apr 29 09:12:58 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (1196f738-ba91-4a05-ac66-ea6afcf0b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bb364e-09d0-4cc8-9059-9360b756f1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bb364e-09d0-4cc8-9059-9360b756f1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1212067540',display_name='tempest-VolumesGetTest-Volume-1355671626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc6450e-0149-4dee-ad29-e7232f8ac659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:58Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6529120-5937-40f2-9e49-f1ee4ece6953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6529120-5937-40f2-9e49-f1ee4ece6953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8706eaa2-ad35-4e78-b58a-a69693870518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8706eaa2-ad35-4e78-b58a-a69693870518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc6450e-0149-4dee-ad29-e7232f8ac659', 'volume_name': 'volume-5cc6450e-0149-4dee-ad29-e7232f8ac659', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d91f9a-c1c9-4886-be0b-611feb05cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d91f9a-c1c9-4886-be0b-611feb05cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5e84e0-04d0-484f-b67d-19059fbaabcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:12:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Volume 5cc6450e-0149-4dee-ad29-e7232f8ac659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc6450e-0149-4dee-ad29-e7232f8ac659', 'volume_size': 1}
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:58 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:58 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb is being set with open permissions: ugo+rw
Apr 29 09:12:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:58 devstack sudo[89905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb
Apr 29 09:12:58 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:59 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:12:59 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:59 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb" returned: 0 in 0.560s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:12:59 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.info
Apr 29 09:12:59 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:12:59 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.567s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:12:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:00 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.info" returned: 0 in 0.565s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:00 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.info is being set with open permissions: ugo+rw
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:00 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.info
Apr 29 09:13:00 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:00 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.info" returned: 0 in 0.565s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.831s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.167s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-743235829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06807703-75d3-4a7a-b173-40e16dc837ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f151577c174598828ab1ae7e3f5e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:43Z,use_quota=True,user_id='75bd3d740dfc4c41b6ccfa7d500f6af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Creating volume 06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:00 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea 1073741824
Apr 29 09:13:00 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7b904b31-f8e6-4d84-a04b-9bca9f350890 tempest-VolumesSnapshotTestJSON-1223369711 None] Create snapshot completed successfully
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-a9993d89-5561-475e-b27f-9ff2805edefb-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-a9993d89-5561-475e-b27f-9ff2805edefb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-a9993d89-5561-475e-b27f-9ff2805edefb" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-a9993d89-5561-475e-b27f-9ff2805edefb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Deleting offline snapshot a9993d89-5561-475e-b27f-9ff2805edefb of volume 9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] snapshot_file for this snap is: volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bde7bb-6699-4920-a163-f5963b9c47cf]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:01 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea 1073741824" returned: 0 in 0.771s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:01 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea
Apr 29 09:13:01 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:01 devstack sudo[89923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb
Apr 29 09:13:01 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:02 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.885s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e377c1bd-ee48-4f16-bf8a-1309b053120e,created_at=2026-04-29T07:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1113894842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e377c1bd-ee48-4f16-bf8a-1309b053120e,host='devstack@QuobyteHD#QuobyteHD',id=3bb74a5d-c42c-4716-8873-ce621a3c6164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:52Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(814a879d-a01d-4197-850a-77e6d0ae298a),volume_type_id=814a879d-a01d-4197-850a-77e6d0ae298a)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Creating volume 3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:02 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:02 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb" returned: 0 in 0.698s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:13:02 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 1073741824
Apr 29 09:13:02 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6629c952-2098-4450-8a62-11a757e0f98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06807703-75d3-4a7a-b173-40e16dc837ea', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd5c96a-e648-4235-aa77-ccdcc3761f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ff75f5-2aeb-4042-9fee-7d7b3998be7f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:02 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Volume volume-06807703-75d3-4a7a-b173-40e16dc837ea (06807703-75d3-4a7a-b173-40e16dc837ea): created successfully
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd5c96a-e648-4235-aa77-ccdcc3761f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Flow 'volume_create_manager' (53237dcf-c9e8-4556-9850-23ba41a12c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b05a9a3f-6492-454c-8770-2aa2e5d1b598 tempest-SnapshotDependencyTests-2065259194 None] Created volume successfully.
Apr 29 09:13:02 devstack sudo[89933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2
Apr 29 09:13:02 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:02 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 1073741824" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:02 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" returned: 0 in 0.732s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:02 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb
Apr 29 09:13:02 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:02 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164
Apr 29 09:13:02 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:03 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164" returned: 0 in 0.605s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.070s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:12:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1212067540',display_name='tempest-VolumesGetTest-Volume-1355671626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc6450e-0149-4dee-ad29-e7232f8ac659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:12:58Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Creating volume 5cc6450e-0149-4dee-ad29-e7232f8ac659 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:03 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:03 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659 1073741824
Apr 29 09:13:03 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b498ab9-79d5-4824-82f1-9d02ce8b26b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bb74a5d-c42c-4716-8873-ce621a3c6164', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de58110-c372-4f2a-a147-4db15c2dd0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:03 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Volume volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 (3bb74a5d-c42c-4716-8873-ce621a3c6164): created successfully
Apr 29 09:13:03 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb
Apr 29 09:13:03 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de58110-c372-4f2a-a147-4db15c2dd0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (a497e31a-ac5e-48ac-ab55-21c0763f431c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-25e417ac-8f12-4985-a02f-f78d669820a2 tempest-GroupSnapshotsTest-1882339353 None] Created volume successfully.
Apr 29 09:13:04 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2.a9993d89-5561-475e-b27f-9ff2805edefb" returned: 0 in 0.577s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-a9993d89-5561-475e-b27f-9ff2805edefb" released by "_delete_snapshot" :: held 2.843s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" released by "delete_snapshot" :: held 2.867s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['1935763f-e701-4dd0-b53a-681ff220a3b0', 'a53bd8c4-e0b3-4dd0-a7df-32b68081cf68', '61394f0c-eff6-419f-81dd-47fcbc63ce04', 'de297415-e2ed-4a9f-9aab-6d88fe18055f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Delete snapshot completed successfully.
Apr 29 09:13:04 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659 1073741824" returned: 0 in 0.827s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0edd839-dd0b-4e3f-ba1e-851ed1f4faa7 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-a9993d89-5561-475e-b27f-9ff2805edefb-delete_snapshot" released by "delete_snapshot" :: held 3.034s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:04 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659
Apr 29 09:13:04 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (5554cc18-636e-48e1-8690-9dda9824ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa3b8bf-fa12-4cf2-b104-b834247895e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa3b8bf-fa12-4cf2-b104-b834247895e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641479449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e377c1bd-ee48-4f16-bf8a-1309b053120e,host='devstack@QuobyteHD#QuobyteHD',id=afb16afe-90e5-479d-9b20-b515c8db51ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:05Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(814a879d-a01d-4197-850a-77e6d0ae298a),volume_type_id=814a879d-a01d-4197-850a-77e6d0ae298a)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c4ada6-055a-4ccc-88ec-767a533cf1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c4ada6-055a-4ccc-88ec-767a533cf1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e62e21-b112-4698-b0ae-78daade18b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e62e21-b112-4698-b0ae-78daade18b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb16afe-90e5-479d-9b20-b515c8db51ee', 'volume_name': 'volume-afb16afe-90e5-479d-9b20-b515c8db51ee', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562e7040-fbe2-44cd-889e-722ed5b4602e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562e7040-fbe2-44cd-889e-722ed5b4602e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e5cf46-1491-4d9b-a06f-bba706ce8bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Volume afb16afe-90e5-479d-9b20-b515c8db51ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb16afe-90e5-479d-9b20-b515c8db51ee', 'volume_size': 1}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (ffd1aae1-ad86-4394-9b8f-d18587dcf347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4887f5b2-ad87-4278-a5d7-dfc32857350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4887f5b2-ad87-4278-a5d7-dfc32857350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1135680963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba161531-439d-43a3-92cb-34b2fe377626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:05Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb8ede2-061b-43dc-becb-996e4ba876e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb8ede2-061b-43dc-becb-996e4ba876e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122861c7-86ea-43ae-9ee1-180dd6cc45f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122861c7-86ea-43ae-9ee1-180dd6cc45f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba161531-439d-43a3-92cb-34b2fe377626', 'volume_name': 'volume-ba161531-439d-43a3-92cb-34b2fe377626', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f620fb-a5c5-44a9-9b9c-730dff317b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f620fb-a5c5-44a9-9b9c-730dff317b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9210cdc0-fe7a-4443-8f46-feac2a688bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Volume ba161531-439d-43a3-92cb-34b2fe377626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba161531-439d-43a3-92cb-34b2fe377626', 'volume_size': 1}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:05 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.928s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Creating offline snapshot 99b07f22-d70c-493f-abe4-35b978f540b3 of volume 06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5e84e0-04d0-484f-b67d-19059fbaabcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc6450e-0149-4dee-ad29-e7232f8ac659', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296b4871-c62e-48a4-9378-f50ac5e5e633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e49ab9f-0b18-4dbf-8631-9551e2c15de3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Volume volume-5cc6450e-0149-4dee-ad29-e7232f8ac659 (5cc6450e-0149-4dee-ad29-e7232f8ac659): created successfully
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296b4871-c62e-48a4-9378-f50ac5e5e633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (1196f738-ba91-4a05-ac66-ea6afcf0b54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2254997c-1fdb-4a35-bd7d-1b5b221ed780 tempest-VolumesGetTest-1069336996 None] Created volume successfully.
Apr 29 09:13:05 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea
Apr 29 09:13:05 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:05 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea" returned: 0 in 0.680s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:05 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 1G
Apr 29 09:13:05 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-5cc6450e-0149-4dee-ad29-e7232f8ac659-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Lock "cinder-5cc6450e-0149-4dee-ad29-e7232f8ac659-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-5cc6450e-0149-4dee-ad29-e7232f8ac659" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-5cc6450e-0149-4dee-ad29-e7232f8ac659" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:06 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4004e6c2-bc6c-461e-a9c3-83ba7d5423a6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:06 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659
Apr 29 09:13:06 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:06 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 1G" returned: 0 in 0.759s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06807703-75d3-4a7a-b173-40e16dc837ea -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:06 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06807703-75d3-4a7a-b173-40e16dc837ea -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3
Apr 29 09:13:06 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:06 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659" returned: 0 in 0.766s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:06 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659
Apr 29 09:13:06 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:07 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06807703-75d3-4a7a-b173-40e16dc837ea -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:07 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 is being set with open permissions: ugo+rw
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:07 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3
Apr 29 09:13:07 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:07 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-5cc6450e-0149-4dee-ad29-e7232f8ac659" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-5cc6450e-0149-4dee-ad29-e7232f8ac659" released by "delete_volume" :: held 1.396s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Created reservations ['07a43c84-b6ec-4da2-8d04-05371cfe2dcd', 'f376651e-551e-4683-870e-08d24ab41648', 'fbee5daa-a61d-4c73-a7df-0743b608fe59', 'a668f410-fde9-4e16-a4c8-f98ec18c7af8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:07 devstack sudo[89987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:07 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:07 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3" returned: 0 in 0.581s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:07 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.info
Apr 29 09:13:07 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:08 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.575s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Deleted volume successfully.
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5a5e88bd-905c-420e-b3a2-8cb9e23c706a tempest-VolumesGetTest-1069336996 None] Lock "cinder-5cc6450e-0149-4dee-ad29-e7232f8ac659-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Lock "cinder-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2e1843-4625-4016-b9d1-1bdb6f1ed43a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:08 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.info" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:08 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.info is being set with open permissions: ugo+rw
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:08 devstack sudo[89995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.info
Apr 29 09:13:08 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:08 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606
Apr 29 09:13:08 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:08 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.info" returned: 0 in 0.579s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.929s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.307s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e377c1bd-ee48-4f16-bf8a-1309b053120e,created_at=2026-04-29T07:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-641479449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e377c1bd-ee48-4f16-bf8a-1309b053120e,host='devstack@QuobyteHD#QuobyteHD',id=afb16afe-90e5-479d-9b20-b515c8db51ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:05Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(814a879d-a01d-4197-850a-77e6d0ae298a),volume_type_id=814a879d-a01d-4197-850a-77e6d0ae298a)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Creating volume afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:09 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:09 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" returned: 0 in 0.707s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:09 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee 1073741824
Apr 29 09:13:09 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ab2e8ee7-e0e2-4696-bcd6-2fbb4d068f7b tempest-SnapshotDependencyTests-2065259194 None] Create snapshot completed successfully
Apr 29 09:13:09 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606
Apr 29 09:13:09 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:09 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606" released by "delete_volume" :: held 1.389s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Created reservations ['c8cf9878-26a1-46f5-bb30-2bdc9e604298', '8fdc0bbe-560b-4dbc-b371-dd25117bd533', '4e6bea02-7d42-4d7e-bd03-313824800499', '2cc5eabe-ccf1-4268-83b6-123aedf013ed'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:09 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee 1073741824" returned: 0 in 0.824s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:09 devstack sudo[90011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:09 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:09 devstack sudo[90013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee
Apr 29 09:13:09 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Flow 'volume_create_manager' (23a31b33-75fb-4086-aa4e-3fee6f567d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd6451-0543-4d7c-8c75-58d2be1183df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fd6451-0543-4d7c-8c75-58d2be1183df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62b352b-6e92-4a31-94cc-4200d102d304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61f151577c174598828ab1ae7e3f5e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99b07f22-d70c-493f-abe4-35b978f540b3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:10Z,use_quota=True,user_id='75bd3d740dfc4c41b6ccfa7d500f6af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de534ebd-20e3-4c7e-924b-dfc708eb65ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de534ebd-20e3-4c7e-924b-dfc708eb65ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5e27d6-6eaf-4cc4-9988-b01a21154f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5e27d6-6eaf-4cc4-9988-b01a21154f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c62b352b-6e92-4a31-94cc-4200d102d304', 'volume_name': 'volume-c62b352b-6e92-4a31-94cc-4200d102d304', 'volume_size': 1, 'snapshot_id': '99b07f22-d70c-493f-abe4-35b978f540b3'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207e793c-9627-4454-87b8-888adc187cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207e793c-9627-4454-87b8-888adc187cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b32feb-9051-41b0-bfc9-eae452da346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Volume c62b352b-6e92-4a31-94cc-4200d102d304: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c62b352b-6e92-4a31-94cc-4200d102d304', 'volume_size': 1, 'snapshot_id': '99b07f22-d70c-493f-abe4-35b978f540b3'}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:10 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.637s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Deleted volume successfully.
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-818366bb-07a8-43b4-83be-8550e9094bab tempest-VolumesGetTest-1069336996 None] Lock "cinder-daf50f67-d60c-4dd8-8c1d-2b5b8e78b606-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:10 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee" returned: 0 in 0.644s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.489s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1135680963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba161531-439d-43a3-92cb-34b2fe377626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:05Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Creating volume ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:10 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-06844307-6752-43ee-ba02-06a2f662b4db-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:10 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 1073741824
Apr 29 09:13:10 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e5cf46-1491-4d9b-a06f-bba706ce8bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb16afe-90e5-479d-9b20-b515c8db51ee', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e4fce3-e7ea-4831-88e2-782dd45f34dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Volume volume-afb16afe-90e5-479d-9b20-b515c8db51ee (afb16afe-90e5-479d-9b20-b515c8db51ee): created successfully
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e4fce3-e7ea-4831-88e2-782dd45f34dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (5554cc18-636e-48e1-8690-9dda9824ae29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Lock "cinder-06844307-6752-43ee-ba02-06a2f662b4db-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b477c5e6-f936-40de-8ac0-9386a4431f2e tempest-GroupSnapshotsTest-1882339353 None] Created volume successfully.
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-06844307-6752-43ee-ba02-06a2f662b4db" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-06844307-6752-43ee-ba02-06a2f662b4db" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba1680a-47e5-415c-b6df-13a28f517e98]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:10 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db
Apr 29 09:13:10 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:11 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a87c938b-b214-4f0c-a4a7-5ef7b8ae5c57 tempest-GroupSnapshotsTest-1882339353 None] Update group completed successfully.
Apr 29 09:13:11 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 1073741824" returned: 0 in 0.849s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:11 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:11 devstack sudo[90027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626
Apr 29 09:13:11 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db" returned: 0 in 0.739s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:11 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db
Apr 29 09:13:11 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:11 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626" returned: 0 in 0.578s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.955s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-quobyte-99b07f22-d70c-493f-abe4-35b978f540b3-c62b352b-6e92-4a31-94cc-4200d102d304" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:11 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9210cdc0-fe7a-4443-8f46-feac2a688bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba161531-439d-43a3-92cb-34b2fe377626', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241a6b78-d5be-44fa-878e-3b93b04a2809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-99b07f22-d70c-493f-abe4-35b978f540b3-c62b352b-6e92-4a31-94cc-4200d102d304" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Creating volume c62b352b-6e92-4a31-94cc-4200d102d304 from snapshot 99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-quobyte-c62b352b-6e92-4a31-94cc-4200d102d304" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06844307-6752-43ee-ba02-06a2f662b4db" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-c62b352b-6e92-4a31-94cc-4200d102d304" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] snapshot: 99b07f22-d70c-493f-abe4-35b978f540b3, volume: c62b352b-6e92-4a31-94cc-4200d102d304,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-06844307-6752-43ee-ba02-06a2f662b4db" released by "delete_volume" :: held 1.399s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Volume volume-ba161531-439d-43a3-92cb-34b2fe377626 (ba161531-439d-43a3-92cb-34b2fe377626): created successfully
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241a6b78-d5be-44fa-878e-3b93b04a2809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (ffd1aae1-ad86-4394-9b8f-d18587dcf347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5716cbb6-c16e-4263-9919-3a378212ce7a tempest-VolumesSnapshotTestJSON-1223369711 None] Created volume successfully.
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62ff2c-4758-4619-9627-ed28ee4bb65b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Created reservations ['170b6a9a-d344-490c-b6e2-91e5a1f04f5b', '257c0a94-e089-4b32-a4c4-e35765db9d2e', 'fb8b2582-10fa-4663-bab9-90c7c16484e4', 'e02652cb-2e1f-4333-a3b1-73e7041d21ff'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:12 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3
Apr 29 09:13:12 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:12 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:12 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d74bffbb-5897-434c-a877-038e878264b8 tempest-GroupSnapshotsTest-1882339353 None] Update group completed successfully.
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:12 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.665s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Deleted volume successfully.
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9f33e2c-bb55-4c87-b127-30129a58082f tempest-VolumesGetTest-1069336996 None] Lock "cinder-06844307-6752-43ee-ba02-06a2f662b4db-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:12 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3" returned: 0 in 0.833s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06807703-75d3-4a7a-b173-40e16dc837ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d659e626-bcf3-446d-b26c-439dc227a32b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:13 devstack sudo[90041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea
Apr 29 09:13:13 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (959f25c2-cf30-4e8e-b828-919ef0c2b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90341292-67d4-4a85-8705-7000e5871a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90341292-67d4-4a85-8705-7000e5871a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1051021590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf44a19-35df-4eca-9a85-78a219c772f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:13Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584a3917-3ced-40d0-a8c5-4491ac883ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584a3917-3ced-40d0-a8c5-4491ac883ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a9401a-cc98-4f1e-9177-298304c90e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.image.glance [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 09:13:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1c36b114-62bd-48fd-bdd5-0984de4a299d tempest-GroupSnapshotsTest-1882339353 None] Update group completed successfully.
Apr 29 09:13:13 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea" returned: 0 in 0.760s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:13 devstack sudo[90046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304
Apr 29 09:13:13 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a9401a-cc98-4f1e-9177-298304c90e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cbf44a19-35df-4eca-9a85-78a219c772f0', 'volume_name': 'volume-cbf44a19-35df-4eca-9a85-78a219c772f0', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491df56bd0>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e169a2e3-76f4-48f5-81b9-6bc3253f3297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e169a2e3-76f4-48f5-81b9-6bc3253f3297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792e9b69-332b-4cdb-a99c-90423eb36484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Volume cbf44a19-35df-4eca-9a85-78a219c772f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cbf44a19-35df-4eca-9a85-78a219c772f0', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491df56bd0>}
Apr 29 09:13:13 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Trying to clone cbf44a19-35df-4eca-9a85-78a219c772f0 from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 09:13:14 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 09:13:14 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 09:13:14 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bce9d89-71ef-4a36-b666-8e12288e49e3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:14 devstack sudo[90053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD
Apr 29 09:13:14 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aff182f5-cd8b-4fed-a7ca-075f3225c512 tempest-GroupSnapshotsTest-1882339353 None] Update group completed successfully.
Apr 29 09:13:15 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD" returned: 0 in 1.396s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:15 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f is fetched for user 3faaa462c7ca4ba383587187e48fdd1c. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 09:13:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[313e428f-5bd5-4be4-b128-91a46e1b5dc0]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:16 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD
Apr 29 09:13:16 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] GroupSnapshot 28042c4a-49c3-4f80-9dd4-f46341bd20a0: creating.
Apr 29 09:13:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Group snapshot 28042c4a-49c3-4f80-9dd4-f46341bd20a0: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 09:13:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:17 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD" returned: 0 in 1.570s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:18 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304" returned: 0 in 5.082s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad595a-cdd8-4c90-a9f2-b8deb8ea0e0a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:18 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea
Apr 29 09:13:18 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:19 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea" returned: 0 in 0.813s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:19 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:13:19 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Converted 1024.00 MB image at 201.44 MB/s
Apr 29 09:13:19 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304 is being set with open permissions: ugo+rw
Apr 29 09:13:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:19 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304
Apr 29 09:13:19 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:20 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304" returned: 0 in 0.596s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-c62b352b-6e92-4a31-94cc-4200d102d304" released by "_copy_volume_from_snapshot" :: held 8.197s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-99b07f22-d70c-493f-abe4-35b978f540b3-c62b352b-6e92-4a31-94cc-4200d102d304" released by "_create_volume_from_snapshot" :: held 8.234s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.267s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.667s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Creating offline snapshot 289a1423-e96c-4f54-b538-3b036fc8c624 of volume ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b32feb-9051-41b0-bfc9-eae452da346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62b352b-6e92-4a31-94cc-4200d102d304', 'volume_size': 1, 'snapshot_id': '99b07f22-d70c-493f-abe4-35b978f540b3'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640e3a48-a575-4957-91a1-f615d6007508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8460a2-4286-4b89-952b-036358c7d09f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:20 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Volume volume-c62b352b-6e92-4a31-94cc-4200d102d304 (c62b352b-6e92-4a31-94cc-4200d102d304): created successfully
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640e3a48-a575-4957-91a1-f615d6007508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Flow 'volume_create_manager' (23a31b33-75fb-4086-aa4e-3fee6f567d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-07097ae8-37c1-4492-a8d7-e08595152368 tempest-SnapshotDependencyTests-2065259194 None] Created volume successfully.
Apr 29 09:13:20 devstack sudo[90081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626
Apr 29 09:13:20 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-99b07f22-d70c-493f-abe4-35b978f540b3-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-99b07f22-d70c-493f-abe4-35b978f540b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-quobyte-06807703-75d3-4a7a-b173-40e16dc837ea" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-06807703-75d3-4a7a-b173-40e16dc837ea" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-quobyte-99b07f22-d70c-493f-abe4-35b978f540b3" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-99b07f22-d70c-493f-abe4-35b978f540b3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Deleting offline snapshot 99b07f22-d70c-493f-abe4-35b978f540b3 of volume 06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] snapshot_file for this snap is: volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95102e5-fa4a-478f-b5c5-a4def1f6895c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:21 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626" returned: 0 in 0.761s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:21 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 1G
Apr 29 09:13:21 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:21 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3
Apr 29 09:13:21 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:21 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06807703-75d3-4a7a-b173-40e16dc837ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[065350ae-6e96-41fa-8edd-7dbbd84b8fdb]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:21 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 1G" returned: 0 in 0.807s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba161531-439d-43a3-92cb-34b2fe377626 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:21 devstack sudo[90133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea
Apr 29 09:13:21 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:21 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba161531-439d-43a3-92cb-34b2fe377626 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624
Apr 29 09:13:21 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:22 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea" returned: 0 in 0.701s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:22 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3
Apr 29 09:13:22 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:22 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba161531-439d-43a3-92cb-34b2fe377626 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624" returned: 0 in 0.647s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:22 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 is being set with open permissions: ugo+rw
Apr 29 09:13:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:22 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624
Apr 29 09:13:22 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:23 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624" returned: 0 in 0.592s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:23 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3" returned: 0 in 0.688s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:23 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.info
Apr 29 09:13:23 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:23 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3
Apr 29 09:13:23 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:23 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea.99b07f22-d70c-493f-abe4-35b978f540b3" returned: 0 in 0.579s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:23 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.info" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:23 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.info is being set with open permissions: ugo+rw
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-99b07f22-d70c-493f-abe4-35b978f540b3" released by "_delete_snapshot" :: held 2.805s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-06807703-75d3-4a7a-b173-40e16dc837ea" released by "delete_snapshot" :: held 2.831s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:23 devstack sudo[90163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.info
Apr 29 09:13:23 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Created reservations ['4e732cfc-c73b-49ea-bc5c-a58b6acbf2bb', '3535e6ee-76e6-4005-a85c-ea8c0372b622', 'ebdfd27d-2153-4f91-8af3-ec8359fd5477', '12cfdd08-b2e6-4088-a918-e893f83d98b4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Delete snapshot completed successfully.
Apr 29 09:13:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f860e972-41e1-4665-96bf-3913fa6b0bd5 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-99b07f22-d70c-493f-abe4-35b978f540b3-delete_snapshot" released by "delete_snapshot" :: held 2.973s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-06807703-75d3-4a7a-b173-40e16dc837ea-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-06807703-75d3-4a7a-b173-40e16dc837ea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-quobyte-06807703-75d3-4a7a-b173-40e16dc837ea" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-06807703-75d3-4a7a-b173-40e16dc837ea" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb1495-b1fc-405b-ae50-7f6781517f13]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:24 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.info" returned: 0 in 0.595s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.163s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.055s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:24 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea
Apr 29 09:13:24 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Creating offline snapshot cd30e354-3635-4f89-a0a8-8b28ff9a542f of volume afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:13:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3e9b0116-e747-453b-be1d-53cd5ac01e6a tempest-VolumesSnapshotTestJSON-1223369711 None] Create snapshot completed successfully
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5561ed-d645-4584-8072-a957795a1b1f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:24 devstack sudo[90170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee
Apr 29 09:13:24 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:25 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea" returned: 0 in 0.712s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:25 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea
Apr 29 09:13:25 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:25 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:25 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f 1G
Apr 29 09:13:25 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:25 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-06807703-75d3-4a7a-b173-40e16dc837ea" returned: 0 in 0.705s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-06807703-75d3-4a7a-b173-40e16dc837ea" released by "delete_volume" :: held 1.478s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Created reservations ['12b3be99-ee60-4cd8-a505-eee8aad16c62', '46a4ba40-f64d-4478-ad0c-5a06c8c24adf', 'c17b1c33-6838-4852-81f1-431a70a0effa', '4443a973-bba1-4a3c-99a0-2158ea41f5e8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (6e2257d3-1708-4d79-9cb9-d9942e43ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fa3d10-c426-48d5-8892-b81e6db41acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fa3d10-c426-48d5-8892-b81e6db41acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-738421136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826d6be8-a0ef-4173-9e3b-689e6a1053c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=289a1423-e96c-4f54-b538-3b036fc8c624,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:26Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7d0c1f-5128-4752-b796-3896409f3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7d0c1f-5128-4752-b796-3896409f3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cb78dc-bff3-4394-be75-086da079caf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cb78dc-bff3-4394-be75-086da079caf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '826d6be8-a0ef-4173-9e3b-689e6a1053c3', 'volume_name': 'volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3', 'volume_size': 2, 'snapshot_id': '289a1423-e96c-4f54-b538-3b036fc8c624'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0312e32-202b-4a50-b5c0-e74f642edc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0312e32-202b-4a50-b5c0-e74f642edc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5151c6-1995-459c-bb34-14d2ddfb95da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume 826d6be8-a0ef-4173-9e3b-689e6a1053c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3', 'volume_size': 2, 'snapshot_id': '289a1423-e96c-4f54-b538-3b036fc8c624'}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:25 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f 1G" returned: 0 in 0.805s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb16afe-90e5-479d-9b20-b515c8db51ee -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:25 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:25 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:26 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb16afe-90e5-479d-9b20-b515c8db51ee -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f
Apr 29 09:13:26 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-c62b352b-6e92-4a31-94cc-4200d102d304-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-c62b352b-6e92-4a31-94cc-4200d102d304-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "cinder-quobyte-c62b352b-6e92-4a31-94cc-4200d102d304" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-c62b352b-6e92-4a31-94cc-4200d102d304" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7354362-7bb4-450c-8f7e-e6105b8fbed7]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:26 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Deleted volume successfully.
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc63b516-0d68-483c-912b-b09f6138a5dd tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-06807703-75d3-4a7a-b173-40e16dc837ea-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:26 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304
Apr 29 09:13:26 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:26 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afb16afe-90e5-479d-9b20-b515c8db51ee -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f" returned: 0 in 0.690s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:26 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:13:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:26 devstack sudo[90196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f
Apr 29 09:13:26 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:27 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304" returned: 0 in 0.727s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:27 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f" returned: 0 in 0.596s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:27 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304
Apr 29 09:13:27 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:27 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.info
Apr 29 09:13:27 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:27 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c62b352b-6e92-4a31-94cc-4200d102d304" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-quobyte-c62b352b-6e92-4a31-94cc-4200d102d304" released by "delete_volume" :: held 1.424s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:27 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.info" returned: 0 in 0.652s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:27 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:13:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:27 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.info
Apr 29 09:13:27 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Created reservations ['81efcbe2-0a4f-48e6-9913-616fbf9b0cfa', '921337b4-5cbb-4a96-a0a3-1f4701dec78a', 'a4c62bfe-3094-4949-85d6-76348ce1c896', '57761d55-ffff-4f3b-be6d-f4de334334df'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:28 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:28 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:28 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.info" returned: 0 in 0.642s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.216s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Creating offline snapshot e2310b53-7982-4851-9b09-09ea9eaf8d58 of volume 3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6230ec3-139d-4a86-af09-eb79e9660020]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:28 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.663s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Deleted volume successfully.
Apr 29 09:13:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-edb2ac54-c94f-4ca4-b894-2e21a75f66e9 tempest-SnapshotDependencyTests-2065259194 None] Lock "cinder-c62b352b-6e92-4a31-94cc-4200d102d304-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:28 devstack sudo[90214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164
Apr 29 09:13:28 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:29 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164" returned: 0 in 0.793s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:29 devstack sudo[90220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 1G
Apr 29 09:13:29 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:30 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 1G" returned: 0 in 0.768s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:30 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58
Apr 29 09:13:30 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:30 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58" returned: 0 in 0.599s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:30 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:13:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:30 devstack sudo[90232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58
Apr 29 09:13:30 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:31 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58" returned: 0 in 0.651s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:31 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.info
Apr 29 09:13:31 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:32 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.info" returned: 0 in 0.705s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:32 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:32 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.info
Apr 29 09:13:32 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:32 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.info" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.211s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.910s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-289a1423-e96c-4f54-b538-3b036fc8c624-826d6be8-a0ef-4173-9e3b-689e6a1053c3" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-289a1423-e96c-4f54-b538-3b036fc8c624-826d6be8-a0ef-4173-9e3b-689e6a1053c3" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Creating volume 826d6be8-a0ef-4173-9e3b-689e6a1053c3 from snapshot 289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-826d6be8-a0ef-4173-9e3b-689e6a1053c3" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-826d6be8-a0ef-4173-9e3b-689e6a1053c3" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] snapshot: 289a1423-e96c-4f54-b538-3b036fc8c624, volume: 826d6be8-a0ef-4173-9e3b-689e6a1053c3,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239b663-dc71-4652-b100-9c0aef346025]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-52ccbfd7-86c6-4aeb-8a3a-370e06321995 tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 28042c4a-49c3-4f80-9dd4-f46341bd20a0: created successfully
Apr 29 09:13:33 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624
Apr 29 09:13:33 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:33 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624" returned: 0 in 0.756s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba161531-439d-43a3-92cb-34b2fe377626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:13:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:13:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:13:33 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1780d2a1-62cb-4833-8377-056e8fb067db]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:33 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626
Apr 29 09:13:33 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:34 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 28042c4a-49c3-4f80-9dd4-f46341bd20a0: deleting
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 28042c4a-49c3-4f80-9dd4-f46341bd20a0: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-afb16afe-90e5-479d-9b20-b515c8db51ee" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-afb16afe-90e5-479d-9b20-b515c8db51ee" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-cd30e354-3635-4f89-a0a8-8b28ff9a542f" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-cd30e354-3635-4f89-a0a8-8b28ff9a542f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Deleting offline snapshot cd30e354-3635-4f89-a0a8-8b28ff9a542f of volume afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] snapshot_file for this snap is: volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[713ce5be-de86-4d43-90b2-4e8a0ac5b35d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:34 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626" returned: 0 in 0.782s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:34 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f
Apr 29 09:13:34 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:13:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:34 devstack sudo[90256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3
Apr 29 09:13:34 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:35 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f" returned: 0 in 0.817s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afb16afe-90e5-479d-9b20-b515c8db51ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:13:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ac6f67-b464-4cf0-b614-2508620ed154]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:35 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee
Apr 29 09:13:35 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:37 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee" returned: 0 in 1.811s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:37 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f
Apr 29 09:13:37 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:38 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f" returned: 0 in 1.879s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:39 devstack sudo[90285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f
Apr 29 09:13:39 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:40 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee.cd30e354-3635-4f89-a0a8-8b28ff9a542f" returned: 0 in 1.146s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-cd30e354-3635-4f89-a0a8-8b28ff9a542f" released by "_delete_snapshot" :: held 5.799s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-afb16afe-90e5-479d-9b20-b515c8db51ee" released by "delete_snapshot" :: held 5.834s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=128,cinder:UPDATE=106,cinder:INSERT=28,cinder:DELETE=3 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-3bb74a5d-c42c-4716-8873-ce621a3c6164" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-3bb74a5d-c42c-4716-8873-ce621a3c6164" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-e2310b53-7982-4851-9b09-09ea9eaf8d58" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-e2310b53-7982-4851-9b09-09ea9eaf8d58" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Deleting offline snapshot e2310b53-7982-4851-9b09-09ea9eaf8d58 of volume 3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:13:40 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] snapshot_file for this snap is: volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3" returned: 0 in 5.687s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[78878c39-15b3-497d-b8d5-1d5552251717]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce6b07-f74d-42d3-a3bd-2bfb17cc1ae1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:40 devstack sudo[90290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626
Apr 29 09:13:40 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58
Apr 29 09:13:40 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:40 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:40 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bb74a5d-c42c-4716-8873-ce621a3c6164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[59afad49-f27c-4380-b3ff-cf94b8929af1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:41 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164
Apr 29 09:13:41 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:41 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626" returned: 0 in 0.854s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:13:41 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Converted 1024.00 MB image at 180.03 MB/s
Apr 29 09:13:41 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 is being set with open permissions: ugo+rw
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:41 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3
Apr 29 09:13:41 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:41 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:41 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3" returned: 0 in 0.573s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-826d6be8-a0ef-4173-9e3b-689e6a1053c3" released by "_copy_volume_from_snapshot" :: held 8.805s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-289a1423-e96c-4f54-b538-3b036fc8c624-826d6be8-a0ef-4173-9e3b-689e6a1053c3" released by "_create_volume_from_snapshot" :: held 8.841s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.862s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:41 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58
Apr 29 09:13:41 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.225s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1051021590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf44a19-35df-4eca-9a85-78a219c772f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:13Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Creating volume cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:41 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=127,cinder:SELECT=114,cinder:INSERT=29,cinder:DELETE=13 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:13:41 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 1073741824
Apr 29 09:13:41 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5151c6-1995-459c-bb34-14d2ddfb95da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3', 'volume_size': 2, 'snapshot_id': '289a1423-e96c-4f54-b538-3b036fc8c624'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbbaa82-e315-48dc-ae95-671e8b8b7125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:41 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 (826d6be8-a0ef-4173-9e3b-689e6a1053c3): created successfully
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbbaa82-e315-48dc-ae95-671e8b8b7125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:41 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (6e2257d3-1708-4d79-9cb9-d9942e43ff95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d9df9b4d-cf2c-4f59-bfae-bdd7dc727025 tempest-VolumesSnapshotTestJSON-1223369711 None] Created volume successfully.
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-826d6be8-a0ef-4173-9e3b-689e6a1053c3-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-826d6be8-a0ef-4173-9e3b-689e6a1053c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-826d6be8-a0ef-4173-9e3b-689e6a1053c3" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-826d6be8-a0ef-4173-9e3b-689e6a1053c3" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[03544604-d824-4266-96ef-6a31b343bd85]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:42 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3
Apr 29 09:13:42 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:42 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:42 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58
Apr 29 09:13:42 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:42 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 1073741824" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:42 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0
Apr 29 09:13:42 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:43 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164.e2310b53-7982-4851-9b09-09ea9eaf8d58" returned: 0 in 0.596s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:43 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-e2310b53-7982-4851-9b09-09ea9eaf8d58" released by "_delete_snapshot" :: held 2.847s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-3bb74a5d-c42c-4716-8873-ce621a3c6164" released by "delete_snapshot" :: held 2.883s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:43 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3
Apr 29 09:13:43 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:43 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0" returned: 0 in 0.598s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:43 devstack cinder-volume[83863]: WARNING cinder.quota [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1677391776 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1677391776, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:13:43 devstack cinder-volume[83863]: WARNING cinder.quota [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1677391776 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1677391776, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Attempting download of c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume cbf44a19-35df-4eca-9a85-78a219c772f0. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['7cc67967-4437-4de5-a253-ddb64aa8d179', '431e426c-7c44-46a9-aa43-b976be3cf059', 'e6c50f59-e3e4-4fb8-81a8-000d39ca9059', 'dfa3cfb6-e7d3-403c-9c8c-2ac2dd2da7c3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6feb045-a472-4bf2-8a0c-25dddce825ca]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_7udhxs5s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['96442ab7-bb4b-452f-b64b-78fb21fc1293', 'b11f69bc-0210-4b52-9383-954149093c2d', '05a90c89-e6e9-4e17-8eed-83317619375b', '4e7fd85f-f724-406a-8972-2819a92fc0aa'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:43 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_7udhxs5s
Apr 29 09:13:43 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4edf5e79-ad72-4d1d-8c26-b8c0a4949b84 tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 28042c4a-49c3-4f80-9dd4-f46341bd20a0: deleted successfully
Apr 29 09:13:43 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-826d6be8-a0ef-4173-9e3b-689e6a1053c3" returned: 0 in 0.698s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-826d6be8-a0ef-4173-9e3b-689e6a1053c3" released by "delete_volume" :: held 1.521s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['3fc3d36d-d6b9-4afc-abcd-ac4f15f7adbd', '1be51b74-4bc9-4c2e-8fff-3588f28cf6e5', '5652ef7e-a530-430b-a269-6b0905430dff', '3125eb04-6040-4c61-973a-1ab065dc0baf'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:43 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:43 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:43 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_7udhxs5s" returned: 0 in 0.680s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_7udhxs5s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:44 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_7udhxs5s
Apr 29 09:13:44 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-3bb74a5d-c42c-4716-8873-ce621a3c6164" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-3bb74a5d-c42c-4716-8873-ce621a3c6164" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[223338d2-f3be-477f-a2fe-02457767ff38]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:44 devstack sudo[90345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164
Apr 29 09:13:44 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-289a1423-e96c-4f54-b538-3b036fc8c624-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:44 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-289a1423-e96c-4f54-b538-3b036fc8c624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-ba161531-439d-43a3-92cb-34b2fe377626" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Deleted volume successfully.
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-ba161531-439d-43a3-92cb-34b2fe377626" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-289a1423-e96c-4f54-b538-3b036fc8c624" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-994704e8-4889-4a71-8abe-7c0b17f56a4a tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-826d6be8-a0ef-4173-9e3b-689e6a1053c3-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-289a1423-e96c-4f54-b538-3b036fc8c624" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Deleting offline snapshot 289a1423-e96c-4f54-b538-3b036fc8c624 of volume ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] snapshot_file for this snap is: volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:13:44 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83c3ff8-ebfd-4c61-a708-02f1fbf51a2d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_7udhxs5s" returned: 1 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_7udhxs5s' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f81f9-8628-4cad-aec3-ba77bbeff85c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:44 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624
Apr 29 09:13:44 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:44 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD
Apr 29 09:13:44 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:45 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164" returned: 0 in 0.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:45 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164
Apr 29 09:13:45 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:45 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624" returned: 0 in 0.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba161531-439d-43a3-92cb-34b2fe377626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d02e58-51e8-417a-b0cb-ca67efed1da9]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:45 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:45 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0
Apr 29 09:13:45 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:45 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626
Apr 29 09:13:45 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:45 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3bb74a5d-c42c-4716-8873-ce621a3c6164" returned: 0 in 0.612s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-3bb74a5d-c42c-4716-8873-ce621a3c6164" released by "delete_volume" :: held 1.515s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-afb16afe-90e5-479d-9b20-b515c8db51ee" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-afb16afe-90e5-479d-9b20-b515c8db51ee" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb3adf2-5141-42da-ab79-61ff63482bf6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:46 devstack sudo[90370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee
Apr 29 09:13:46 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:46 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626" returned: 0 in 0.698s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:46 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624
Apr 29 09:13:46 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:46 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee" returned: 0 in 0.820s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:46 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee
Apr 29 09:13:46 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:46 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624" returned: 0 in 0.898s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:47 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624
Apr 29 09:13:47 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:47 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afb16afe-90e5-479d-9b20-b515c8db51ee" returned: 0 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:47 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0" returned: 0 in 1.975s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_a9of9zwxdevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:13:47 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Converted 112.00 MB image at 56.68 MB/s
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-afb16afe-90e5-479d-9b20-b515c8db51ee" released by "delete_volume" :: held 1.535s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:47 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 1G
Apr 29 09:13:47 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['674ef0a8-8f3b-442b-abf6-5f585f6b71c2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:47 devstack cinder-volume[83863]: WARNING cinder.quota [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1677391776 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1677391776, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['53193c19-a26c-4e1f-b847-8b739bfce958', 'ee2bb760-b6bb-408d-ba45-839fe4438f73', '3091712a-0ee5-416e-803e-8b41a8551850', 'ffc899e9-ca6f-4acd-b7b5-931dda7fb866'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:47 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626.289a1423-e96c-4f54-b538-3b036fc8c624" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-289a1423-e96c-4f54-b538-3b036fc8c624" released by "_delete_snapshot" :: held 3.007s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-ba161531-439d-43a3-92cb-34b2fe377626" released by "delete_snapshot" :: held 3.052s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['ece04d6d-a3fe-407b-903f-4bbaa61e3ca1', '37158235-0855-468e-b9a1-407880b690b3', '8ee511de-c854-416d-9a44-21b1c4c4d895', '3a14ba1f-5616-4290-b2aa-634e7911d845'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['cf9c9f0d-36a4-4699-927e-34eb06655485', '0dffcb46-8550-4f40-b7a1-2b725f845551', '462b96ad-d2ff-443a-ae09-8cad5720d032', '41810b16-4ef8-4d9c-be3d-5bb738e91b18'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Delete snapshot completed successfully.
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-139f1ea9-2ae7-4213-809d-5a621b7c4f62 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-289a1423-e96c-4f54-b538-3b036fc8c624-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:47 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:47 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:48 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 1G" returned: 0 in 0.672s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1a83c7-2dd0-47fd-8f9c-583c300bf537]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:48 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0
Apr 29 09:13:48 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:48 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6e4a2087-085a-4d05-bdbc-b67d065468bb tempest-GroupSnapshotsTest-1882339353 None] Delete group completed successfully.
Apr 29 09:13:48 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0" returned: 0 in 0.707s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-ba161531-439d-43a3-92cb-34b2fe377626-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-ba161531-439d-43a3-92cb-34b2fe377626-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-ba161531-439d-43a3-92cb-34b2fe377626" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:48 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0
Apr 29 09:13:48 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-ba161531-439d-43a3-92cb-34b2fe377626" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ac2455-e5e2-493a-be73-f877b51fde11]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:49 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626
Apr 29 09:13:49 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-68898085-c6d0-496e-875a-7e028dacfbd4 tempest-GroupSnapshotsTest-1882339353 None] Group tempest-GroupSnapshotsTest-Group-2069969165: creating
Apr 29 09:13:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-68898085-c6d0-496e-875a-7e028dacfbd4 tempest-GroupSnapshotsTest-1882339353 None] Group tempest-GroupSnapshotsTest-Group-2069969165: created successfully
Apr 29 09:13:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-68898085-c6d0-496e-875a-7e028dacfbd4 tempest-GroupSnapshotsTest-1882339353 None] Create group completed successfully.
Apr 29 09:13:49 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0" returned: 1 in 0.725s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Downloaded image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume cbf44a19-35df-4eca-9a85-78a219c772f0 successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f for user 3faaa462c7ca4ba383587187e48fdd1c is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Marking volume cbf44a19-35df-4eca-9a85-78a219c772f0 as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Copying metadata from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f to cbf44a19-35df-4eca-9a85-78a219c772f0. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Creating volume glance metadata for volume cbf44a19-35df-4eca-9a85-78a219c772f0 backed by image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792e9b69-332b-4cdb-a99c-90423eb36484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf44a19-35df-4eca-9a85-78a219c772f0', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491df56bd0>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e20823-9582-4f61-b865-3c886118ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Volume volume-cbf44a19-35df-4eca-9a85-78a219c772f0 (cbf44a19-35df-4eca-9a85-78a219c772f0): created successfully
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e20823-9582-4f61-b865-3c886118ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (959f25c2-cf30-4e8e-b828-919ef0c2b49a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-26ec7cad-0bfa-4641-9fa1-1a1c490b5ef0 tempest-VolumesGetTest-1069336996 None] Created volume successfully.
Apr 29 09:13:49 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626" returned: 0 in 0.745s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:49 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626
Apr 29 09:13:49 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:50 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba161531-439d-43a3-92cb-34b2fe377626" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-ba161531-439d-43a3-92cb-34b2fe377626" released by "delete_volume" :: held 1.476s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['3e25accf-1713-4879-97b2-b99c397f552f', 'c7a8908d-e2de-459e-86ef-4de429d8465c', '34bb59d3-3016-4bc0-a4cd-332cec8bad85', 'cf255903-7bfe-48a0-ae15-fc302fdf88db'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:50 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:50 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:50 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (09566c1e-db7f-4548-afd4-66ec02e37199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34ef605-fedf-4c8c-a3bb-c47d63bca9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (1b3d2617-f169-47b1-9ee4-ad4b15ffa6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d5d8f6-2d4a-4ca1-8f69-4338863a4766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34ef605-fedf-4c8c-a3bb-c47d63bca9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-436147294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d15a86b-29b8-45a9-8b7f-4ededebdada2,host='devstack@QuobyteHD#QuobyteHD',id=a2b54748-4a85-4f72-9050-eeac5d1d689d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:51Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70f0b940-4969-450c-8642-13cda73d94e1),volume_type_id=70f0b940-4969-450c-8642-13cda73d94e1)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154f9a5e-71fc-451b-8f3f-5e5602f4abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154f9a5e-71fc-451b-8f3f-5e5602f4abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa76e7-4646-48e6-8958-09ea460b2c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa76e7-4646-48e6-8958-09ea460b2c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b54748-4a85-4f72-9050-eeac5d1d689d', 'volume_name': 'volume-a2b54748-4a85-4f72-9050-eeac5d1d689d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1392f4a-94b0-487c-986b-994a8dad5812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1392f4a-94b0-487c-986b-994a8dad5812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904a9522-4699-406a-affc-f0c4f28aadee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Volume a2b54748-4a85-4f72-9050-eeac5d1d689d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b54748-4a85-4f72-9050-eeac5d1d689d', 'volume_size': 1}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4d15a86b-29b8-45a9-8b7f-4ededebdada2,created_at=2026-04-29T07:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-436147294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d15a86b-29b8-45a9-8b7f-4ededebdada2,host='devstack@QuobyteHD#QuobyteHD',id=a2b54748-4a85-4f72-9050-eeac5d1d689d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd728e4a328447efb27fef9f7819f891',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:51Z,use_quota=True,user_id='d51b57882a784bafa72632000514451a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70f0b940-4969-450c-8642-13cda73d94e1),volume_type_id=70f0b940-4969-450c-8642-13cda73d94e1)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Creating volume a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:51 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d5d8f6-2d4a-4ca1-8f69-4338863a4766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-973126657',display_name='tempest-VolumesGetTest-Volume-1363449880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407cc8bc-2d19-4fe1-8ac7-b93eebe7967c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:51Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7359331d-cc62-4f38-b7ea-555ffa29f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7359331d-cc62-4f38-b7ea-555ffa29f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d 1073741824
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f7f2ea-2520-4e58-9f30-88d1da1ffdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f7f2ea-2520-4e58-9f30-88d1da1ffdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407cc8bc-2d19-4fe1-8ac7-b93eebe7967c', 'volume_name': 'volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de2030b-a2d7-420e-8a44-d6f7ac85ba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de2030b-a2d7-420e-8a44-d6f7ac85ba39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72488f24-2ebd-452b-a5bc-ca0e04542e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Volume 407cc8bc-2d19-4fe1-8ac7-b93eebe7967c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c', 'volume_size': 1}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:51 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Deleted volume successfully.
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2f694a5b-0c05-4ce7-a997-4a390fab880b tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-ba161531-439d-43a3-92cb-34b2fe377626-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (c52a16f9-8e2b-4754-bd9e-b2ebcb8a5fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447c509f-61b8-4523-879f-cc6e755de0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447c509f-61b8-4523-879f-cc6e755de0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-618640596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81909a09-9fa7-4938-853c-3b883fba8a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:52Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5955470-a457-43a9-90b0-b1c9f98fbc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5955470-a457-43a9-90b0-b1c9f98fbc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a84687-25ed-47c4-b1bb-5647c691ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a84687-25ed-47c4-b1bb-5647c691ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81909a09-9fa7-4938-853c-3b883fba8a1f', 'volume_name': 'volume-81909a09-9fa7-4938-853c-3b883fba8a1f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c10a33-10c5-41bc-a6c3-c1a2b15dff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c10a33-10c5-41bc-a6c3-c1a2b15dff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d12df67-c912-45f4-b5f2-a2a97dc483f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume 81909a09-9fa7-4938-853c-3b883fba8a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81909a09-9fa7-4938-853c-3b883fba8a1f', 'volume_size': 1}
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:51 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d 1073741824" returned: 0 in 0.855s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:52 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d
Apr 29 09:13:52 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:52 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d" returned: 0 in 0.570s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-973126657',display_name='tempest-VolumesGetTest-Volume-1363449880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407cc8bc-2d19-4fe1-8ac7-b93eebe7967c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13979e08a4d443fd9a9179ff8ae6c8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:51Z,use_quota=True,user_id='3faaa462c7ca4ba383587187e48fdd1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Creating volume 407cc8bc-2d19-4fe1-8ac7-b93eebe7967c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:52 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:52 devstack sudo[90440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c 1073741824
Apr 29 09:13:52 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904a9522-4699-406a-affc-f0c4f28aadee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b54748-4a85-4f72-9050-eeac5d1d689d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a866e3-f8ac-4d26-b5c5-d7fa5fff0c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Volume volume-a2b54748-4a85-4f72-9050-eeac5d1d689d (a2b54748-4a85-4f72-9050-eeac5d1d689d): created successfully
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a866e3-f8ac-4d26-b5c5-d7fa5fff0c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Flow 'volume_create_manager' (09566c1e-db7f-4548-afd4-66ec02e37199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d80a77ac-811e-4262-9dd7-b4bcd42e8c0c tempest-GroupSnapshotsTest-1882339353 None] Created volume successfully.
Apr 29 09:13:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] GroupSnapshot 687ed45f-a985-4d6e-8a49-78604d30cec0: creating.
Apr 29 09:13:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Group snapshot 687ed45f-a985-4d6e-8a49-78604d30cec0: creating. {{(pid=83863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 29 09:13:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:53 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c 1073741824" returned: 0 in 0.811s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:53 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c
Apr 29 09:13:53 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:54 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c" returned: 0 in 0.581s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-618640596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81909a09-9fa7-4938-853c-3b883fba8a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:13:52Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Creating volume 81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:13:54 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:54 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f 1073741824
Apr 29 09:13:54 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72488f24-2ebd-452b-a5bc-ca0e04542e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67185ed5-a72c-4111-86c9-8603ebd70bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Volume volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c (407cc8bc-2d19-4fe1-8ac7-b93eebe7967c): created successfully
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67185ed5-a72c-4111-86c9-8603ebd70bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Flow 'volume_create_manager' (1b3d2617-f169-47b1-9ee4-ad4b15ffa6af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7db2f7c4-e308-40df-9c7d-98d4ac14b5cd tempest-VolumesGetTest-1069336996 None] Created volume successfully.
Apr 29 09:13:54 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f 1073741824" returned: 0 in 0.750s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:54 devstack sudo[90456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f
Apr 29 09:13:54 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Lock "cinder-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8e242d-bd0f-4104-8b61-9f2837d010c8]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:55 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.079s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d12df67-c912-45f4-b5f2-a2a97dc483f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81909a09-9fa7-4938-853c-3b883fba8a1f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fdcea3-6aec-4d29-823d-11747676afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Creating offline snapshot bd606c1e-984c-4649-a05c-d410c55f893d of volume a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:13:55 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume volume-81909a09-9fa7-4938-853c-3b883fba8a1f (81909a09-9fa7-4938-853c-3b883fba8a1f): created successfully
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2fdcea3-6aec-4d29-823d-11747676afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (c52a16f9-8e2b-4754-bd9e-b2ebcb8a5fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a405d6-9b7a-4366-8397-4ce673b60b62]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:55 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c
Apr 29 09:13:55 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c624f8ae-505f-4c20-9777-fe4e3c8706e8 tempest-VolumesSnapshotTestJSON-1223369711 None] Created volume successfully.
Apr 29 09:13:55 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d
Apr 29 09:13:55 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:56 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c" returned: 0 in 0.714s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:56 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c
Apr 29 09:13:56 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:56 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d" returned: 0 in 0.760s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:56 devstack sudo[90471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d 1G
Apr 29 09:13:56 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:56 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c" returned: 0 in 0.589s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c" released by "delete_volume" :: held 1.354s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Created reservations ['055415af-05ad-4a1b-a28e-254842860554', '6beb1086-1ce2-4c79-8467-52661cadbd42', '6ba3b3a8-805d-490d-8d4f-d16cffb9a81d', 'cb58b287-a893-4f80-bf2e-9409c4d970d7'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:56 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:56 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:56 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d 1G" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b54748-4a85-4f72-9050-eeac5d1d689d -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:57 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b54748-4a85-4f72-9050-eeac5d1d689d -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d
Apr 29 09:13:57 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:57 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.604s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Deleted volume successfully.
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-25c05ae1-9941-482b-adc2-5e6cc7fbc3d3 tempest-VolumesGetTest-1069336996 None] Lock "cinder-407cc8bc-2d19-4fe1-8ac7-b93eebe7967c-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-cbf44a19-35df-4eca-9a85-78a219c772f0-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Lock "cinder-cbf44a19-35df-4eca-9a85-78a219c772f0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:57 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b54748-4a85-4f72-9050-eeac5d1d689d -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:57 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Acquiring lock "cinder-quobyte-cbf44a19-35df-4eca-9a85-78a219c772f0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:57 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d
Apr 29 09:13:57 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-cbf44a19-35df-4eca-9a85-78a219c772f0" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[906b1482-1aa7-4f1b-ad1c-2b80a013c5f9]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:57 devstack sudo[90487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0
Apr 29 09:13:57 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:58 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:58 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.info
Apr 29 09:13:58 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:58 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:58 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0
Apr 29 09:13:58 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:58 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.info" returned: 0 in 0.566s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:58 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 29 09:13:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:58 devstack sudo[90497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.info
Apr 29 09:13:58 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:59 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0" returned: 1 in 0.722s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:59 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0
Apr 29 09:13:59 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:59 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:13:59 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:59 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.info" returned: 0 in 0.578s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.993s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.433s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Creating offline snapshot a9cb6d31-ea36-453a-bf81-bf523b8f1e41 of volume 81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[945ec9a0-39e0-401b-bfae-783fd447059a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:13:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-afb468af-98c6-4f60-85ad-b9f33f3e8b0b tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 687ed45f-a985-4d6e-8a49-78604d30cec0: created successfully
Apr 29 09:13:59 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f
Apr 29 09:13:59 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:13:59 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cbf44a19-35df-4eca-9a85-78a219c772f0" returned: 0 in 0.668s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Lock "cinder-quobyte-cbf44a19-35df-4eca-9a85-78a219c772f0" released by "delete_volume" :: held 2.137s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:13:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 687ed45f-a985-4d6e-8a49-78604d30cec0: deleting
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Created reservations ['45fada23-06ea-47ca-a1d5-ded4f2ce867c', 'cae85b3e-134f-42ce-b853-a7869b660b3e', 'b2ccaffd-6092-4481-b089-d9733d5266dd', '6ba82a97-1bd1-410a-a9d4-8e90d6ecf9ac'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 687ed45f-a985-4d6e-8a49-78604d30cec0: deleting {{(pid=83863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 29 09:13:59 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.752s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-a2b54748-4a85-4f72-9050-eeac5d1d689d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-a2b54748-4a85-4f72-9050-eeac5d1d689d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:13:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-bd606c1e-984c-4649-a05c-d410c55f893d" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-bd606c1e-984c-4649-a05c-d410c55f893d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Deleting offline snapshot bd606c1e-984c-4649-a05c-d410c55f893d of volume a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] snapshot_file for this snap is: volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[55daf830-e5ee-4e40-a323-14f307cf590a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:00 devstack sudo[90511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:14:00 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:00 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d
Apr 29 09:14:00 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:00 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f" returned: 0 in 0.867s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:00 devstack sudo[90518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 1G
Apr 29 09:14:00 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:00 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.600s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:14:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Deleted volume successfully.
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d3f067cc-1ac2-4c8f-a8fc-4be1fbb3528a tempest-VolumesGetTest-1069336996 None] Lock "cinder-cbf44a19-35df-4eca-9a85-78a219c772f0-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:00 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2b54748-4a85-4f72-9050-eeac5d1d689d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[629d2180-da81-4010-87a1-d3569ed9cd9a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:00 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d
Apr 29 09:14:00 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:01 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 1G" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81909a09-9fa7-4938-853c-3b883fba8a1f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:01 devstack sudo[90530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81909a09-9fa7-4938-853c-3b883fba8a1f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41
Apr 29 09:14:01 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:01 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d" returned: 0 in 0.747s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:01 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d
Apr 29 09:14:01 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:01 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81909a09-9fa7-4938-853c-3b883fba8a1f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41" returned: 0 in 0.763s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:01 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 is being set with open permissions: ugo+rw
Apr 29 09:14:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:01 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41
Apr 29 09:14:01 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:02 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d" returned: 0 in 0.747s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:02 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d
Apr 29 09:14:02 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:02 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:02 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.info
Apr 29 09:14:02 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:02 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d.bd606c1e-984c-4649-a05c-d410c55f893d" returned: 0 in 0.598s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-bd606c1e-984c-4649-a05c-d410c55f893d" released by "_delete_snapshot" :: held 3.017s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-a2b54748-4a85-4f72-9050-eeac5d1d689d" released by "delete_snapshot" :: held 3.051s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:03 devstack cinder-volume[83863]: WARNING cinder.quota [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1565394508 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1565394508, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:14:03 devstack cinder-volume[83863]: WARNING cinder.quota [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1565394508 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1565394508, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:14:03 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['d8a8099b-3d21-49bc-ad01-5950c4400807', '25e7f64a-dcee-4deb-888e-5ef580f40c68', 'cceadfe4-b03b-4d2d-abf4-6d15940b136d', 'a1d7e444-b9d3-4acc-b7e4-706e1dd25c0a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ea68b070-2405-478f-8bcd-3b32697f304e tempest-GroupSnapshotsTest-1882339353 None] group_snapshot 687ed45f-a985-4d6e-8a49-78604d30cec0: deleted successfully
Apr 29 09:14:03 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.info" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:03 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.info is being set with open permissions: ugo+rw
Apr 29 09:14:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:03 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.info
Apr 29 09:14:03 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:04 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.info" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.622s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1d697b86-81cb-4d58-b85d-fcd5545252cf tempest-VolumesSnapshotTestJSON-1223369711 None] Create snapshot completed successfully
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "cinder-quobyte-a2b54748-4a85-4f72-9050-eeac5d1d689d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-a2b54748-4a85-4f72-9050-eeac5d1d689d" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92553fcd-49a2-4e73-a700-39bf52bb7e9b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:04 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d
Apr 29 09:14:04 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (0de60ef8-e475-4825-a66a-74c248ab8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda1e554-62e2-496c-8ebe-9f1b95d7519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda1e554-62e2-496c-8ebe-9f1b95d7519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1807150999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c36c99-d200-4fb4-9585-af8b7d04d8b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9fd31e67be4c9aa26f7ab56dfe9f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9cb6d31-ea36-453a-bf81-bf523b8f1e41,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:05Z,use_quota=True,user_id='ba58a6682c514894b6c4e078cd456221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935fc2b8-2307-4ba3-8b2d-a58b03b75067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (935fc2b8-2307-4ba3-8b2d-a58b03b75067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60225de2-d397-478a-9f2d-b7322e3b1e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60225de2-d397-478a-9f2d-b7322e3b1e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b1c36c99-d200-4fb4-9585-af8b7d04d8b1', 'volume_name': 'volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1', 'volume_size': 1, 'snapshot_id': 'a9cb6d31-ea36-453a-bf81-bf523b8f1e41'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2388823-df3a-479e-9622-9c73e518d892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2388823-df3a-479e-9622-9c73e518d892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4865bb4-706b-4feb-86a3-6cff5ad918b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume b1c36c99-d200-4fb4-9585-af8b7d04d8b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1', 'volume_size': 1, 'snapshot_id': 'a9cb6d31-ea36-453a-bf81-bf523b8f1e41'}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-a9cb6d31-ea36-453a-bf81-bf523b8f1e41-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-a9cb6d31-ea36-453a-bf81-bf523b8f1e41-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Creating volume b1c36c99-d200-4fb4-9585-af8b7d04d8b1 from snapshot a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:14:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] snapshot: a9cb6d31-ea36-453a-bf81-bf523b8f1e41, volume: b1c36c99-d200-4fb4-9585-af8b7d04d8b1,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[503097f8-7933-4c0b-9325-6f2e81c5877f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:05 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41
Apr 29 09:14:05 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:05 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d" returned: 0 in 0.797s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:05 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d
Apr 29 09:14:05 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:05 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41" returned: 0 in 0.830s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81909a09-9fa7-4938-853c-3b883fba8a1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a054509-6036-43b9-9c8b-3b247e373127]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:06 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f
Apr 29 09:14:06 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:06 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a2b54748-4a85-4f72-9050-eeac5d1d689d" returned: 0 in 0.642s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Lock "cinder-quobyte-a2b54748-4a85-4f72-9050-eeac5d1d689d" released by "delete_volume" :: held 1.528s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['6c6f7c9f-81ad-4b01-9e5a-726c81b2d6a2'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:06 devstack cinder-volume[83863]: WARNING cinder.quota [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1565394508 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1565394508, it is now deprecated. Please use the default quota class for default quota.
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Created reservations ['c760d093-1b50-493b-b91a-5bde3988e680', '39fad6b4-0050-4849-a173-e25810408669', '5fe162b8-8a6f-484c-bec9-d806c879a051', '6beda310-fad3-42a3-9c6f-7a79c7db61ba'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:06 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:14:06 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:06 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f" returned: 0 in 0.762s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:14:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:06 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1
Apr 29 09:14:06 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Flow 'volume_create_manager' (da2e2f8b-dae7-4a17-a48e-735102de1216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144f9694-3267-4e53-aec8-df00042f35dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144f9694-3267-4e53-aec8-df00042f35dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-9428065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63be00-ec38-49bc-8d49-5dc377e531a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15b3d3395704434b0ab51e3907e41e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:07Z,use_quota=True,user_id='bf0530c57280437e99fd2d0fcddd2959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:07 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad7c6f7-c358-43e7-85d3-e079c44ee8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad7c6f7-c358-43e7-85d3-e079c44ee8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d5b9dc-6da2-422b-a2d9-eb87a97aa541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d5b9dc-6da2-422b-a2d9-eb87a97aa541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b63be00-ec38-49bc-8d49-5dc377e531a0', 'volume_name': 'volume-7b63be00-ec38-49bc-8d49-5dc377e531a0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53f9583-f07a-40e8-84da-55f30b9ba0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53f9583-f07a-40e8-84da-55f30b9ba0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7166163b-2081-4be2-bf80-4223fcfe684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:07 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Volume 7b63be00-ec38-49bc-8d49-5dc377e531a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b63be00-ec38-49bc-8d49-5dc377e531a0', 'volume_size': 1}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.812s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:14:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-da66d0d4-652b-46ae-b216-cdc4f49bd916 tempest-GroupSnapshotsTest-1882339353 None] Delete group completed successfully.
Apr 29 09:14:11 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" returned: 0 in 5.255s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3496a63c-e44e-41e0-aeea-35892a3aea54]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:12 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f
Apr 29 09:14:12 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:12 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f" returned: 0 in 0.855s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:12 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:14:12 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Converted 1024.00 MB image at 194.85 MB/s
Apr 29 09:14:12 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 is being set with open permissions: ugo+rw
Apr 29 09:14:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:12 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1
Apr 29 09:14:12 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:13 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" returned: 0 in 0.576s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" released by "_copy_volume_from_snapshot" :: held 8.369s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-a9cb6d31-ea36-453a-bf81-bf523b8f1e41-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" released by "_create_volume_from_snapshot" :: held 8.402s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.420s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.199s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-9428065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63be00-ec38-49bc-8d49-5dc377e531a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15b3d3395704434b0ab51e3907e41e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:07Z,use_quota=True,user_id='bf0530c57280437e99fd2d0fcddd2959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Creating volume 7b63be00-ec38-49bc-8d49-5dc377e531a0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:14:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:13 devstack sudo[90598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0 1073741824
Apr 29 09:14:13 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4865bb4-706b-4feb-86a3-6cff5ad918b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1', 'volume_size': 1, 'snapshot_id': 'a9cb6d31-ea36-453a-bf81-bf523b8f1e41'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbbdda8-7ab9-408d-98df-8f171f0612af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Volume volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 (b1c36c99-d200-4fb4-9585-af8b7d04d8b1): created successfully
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dbbdda8-7ab9-408d-98df-8f171f0612af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Flow 'volume_create_manager' (0de60ef8-e475-4825-a66a-74c248ab8a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ca411364-b338-4752-9b26-73a5313eea21 tempest-VolumesSnapshotTestJSON-1223369711 None] Created volume successfully.
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-b1c36c99-d200-4fb4-9585-af8b7d04d8b1-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-b1c36c99-d200-4fb4-9585-af8b7d04d8b1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66c6da-554a-4700-9a42-5b7123ef66e3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:14 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1
Apr 29 09:14:14 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:14 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0 1073741824" returned: 0 in 0.830s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:14 devstack sudo[90606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0
Apr 29 09:14:14 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:14 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:14 devstack sudo[90611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1
Apr 29 09:14:14 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:14 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7166163b-2081-4be2-bf80-4223fcfe684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b63be00-ec38-49bc-8d49-5dc377e531a0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f568a4-ec9e-4c7b-8f43-ccd6914c9b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Volume volume-7b63be00-ec38-49bc-8d49-5dc377e531a0 (7b63be00-ec38-49bc-8d49-5dc377e531a0): created successfully
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f568a4-ec9e-4c7b-8f43-ccd6914c9b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Flow 'volume_create_manager' (da2e2f8b-dae7-4a17-a48e-735102de1216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-22aad3eb-1b7c-4b58-bf01-1effa5daf1ed tempest-VolumesNegativeTest-588370816 None] Created volume successfully.
Apr 29 09:14:15 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-b1c36c99-d200-4fb4-9585-af8b7d04d8b1" released by "delete_volume" :: held 1.448s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['9a3a4fb9-a6dc-4b88-9be9-b9a04d58bdcc', '2b45513f-e115-4bce-b9c8-3159fa712e39', '09587abf-5bad-46ba-a7aa-229e20e92169', '21e5ca94-8909-418a-b958-8f6172f7f76e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:15 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:14:15 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-a9cb6d31-ea36-453a-bf81-bf523b8f1e41-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:16 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.824s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-a9cb6d31-ea36-453a-bf81-bf523b8f1e41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-81909a09-9fa7-4938-853c-3b883fba8a1f" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Deleted volume successfully.
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-81909a09-9fa7-4938-853c-3b883fba8a1f" acquired by "delete_snapshot" :: waited 0.047s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-a9cb6d31-ea36-453a-bf81-bf523b8f1e41" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7e30585a-ef80-4ac1-8c7c-010af3f11c46 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-b1c36c99-d200-4fb4-9585-af8b7d04d8b1-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-a9cb6d31-ea36-453a-bf81-bf523b8f1e41" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Deleting offline snapshot a9cb6d31-ea36-453a-bf81-bf523b8f1e41 of volume 81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] snapshot_file for this snap is: volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c75b5-e024-4765-bc2b-97d082eec62d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:16 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41
Apr 29 09:14:16 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:17 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41" returned: 0 in 1.012s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81909a09-9fa7-4938-853c-3b883fba8a1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e41fdc-bb99-483d-a25c-15d52c40b4d6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:17 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f
Apr 29 09:14:17 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:18 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f" returned: 0 in 0.723s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:18 devstack sudo[90631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41
Apr 29 09:14:18 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:19 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41" returned: 0 in 0.712s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:19 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41
Apr 29 09:14:19 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Flow 'volume_create_manager' (9ba3c4b7-16a3-4e44-803d-9b6bb47a4fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba783135-8781-4362-a8dc-a3fb05d3bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba783135-8781-4362-a8dc-a3fb05d3bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1883663131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95476fd9-fde2-413f-9608-55d44e60ab4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1034fca2285844f3b372ca3258d0d127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:19Z,use_quota=True,user_id='60171029b8354fbb8a8bf8e9ea17271a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760943de-6e65-406f-b1d1-b0194363f168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760943de-6e65-406f-b1d1-b0194363f168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b169ee75-7985-417b-9bd6-21c3633a9202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b169ee75-7985-417b-9bd6-21c3633a9202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95476fd9-fde2-413f-9608-55d44e60ab4d', 'volume_name': 'volume-95476fd9-fde2-413f-9608-55d44e60ab4d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5a4938-f06b-43a1-bf2a-a216e97718eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5a4938-f06b-43a1-bf2a-a216e97718eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ca66e-2762-4ec5-92f8-96c6798459b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Volume 95476fd9-fde2-413f-9608-55d44e60ab4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95476fd9-fde2-413f-9608-55d44e60ab4d', 'volume_size': 1}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1883663131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95476fd9-fde2-413f-9608-55d44e60ab4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1034fca2285844f3b372ca3258d0d127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:19Z,use_quota=True,user_id='60171029b8354fbb8a8bf8e9ea17271a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Creating volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:14:19 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:19 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f.a9cb6d31-ea36-453a-bf81-bf523b8f1e41" returned: 0 in 0.651s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:19 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d 1073741824
Apr 29 09:14:19 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-a9cb6d31-ea36-453a-bf81-bf523b8f1e41" released by "_delete_snapshot" :: held 3.245s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-81909a09-9fa7-4938-853c-3b883fba8a1f" released by "delete_snapshot" :: held 3.286s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['89c04f4d-0f54-4c41-9b9e-f23cf7809eb1', 'f655c32a-32ee-498b-a8f5-044837261363', 'e11b7334-77e8-47ca-bdcb-97668fefe2a0', 'f203c480-89d3-4ca1-a1ba-c547161e857a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Delete snapshot completed successfully.
Apr 29 09:14:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-549e3cfd-feaf-408c-a539-dc5e153b95f1 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-a9cb6d31-ea36-453a-bf81-bf523b8f1e41-delete_snapshot" released by "delete_snapshot" :: held 3.449s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:20 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d 1073741824" returned: 0 in 0.749s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:20 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d
Apr 29 09:14:20 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-81909a09-9fa7-4938-853c-3b883fba8a1f-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-81909a09-9fa7-4938-853c-3b883fba8a1f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-81909a09-9fa7-4938-853c-3b883fba8a1f" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-81909a09-9fa7-4938-853c-3b883fba8a1f" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb53db2-2f60-4ad4-8936-9a174b4c4617]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:20 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f
Apr 29 09:14:20 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:21 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ca66e-2762-4ec5-92f8-96c6798459b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95476fd9-fde2-413f-9608-55d44e60ab4d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520a65cf-e3b7-4b2e-8936-0d94a35145a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Volume volume-95476fd9-fde2-413f-9608-55d44e60ab4d (95476fd9-fde2-413f-9608-55d44e60ab4d): created successfully
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520a65cf-e3b7-4b2e-8936-0d94a35145a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Flow 'volume_create_manager' (9ba3c4b7-16a3-4e44-803d-9b6bb47a4fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-51a781ae-dc08-406d-93dd-dce0872e46ef tempest-SnapshotsActionsTest-604834956 None] Created volume successfully.
Apr 29 09:14:21 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f" returned: 0 in 0.852s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:21 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f
Apr 29 09:14:21 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Creating offline snapshot c5d74501-d297-4343-9be7-6984ba6fc426 of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:21 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee3bf19-6d25-4d37-9231-0723702e25c4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:22 devstack sudo[90692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d
Apr 29 09:14:22 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:22 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-81909a09-9fa7-4938-853c-3b883fba8a1f" returned: 0 in 0.920s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-81909a09-9fa7-4938-853c-3b883fba8a1f" released by "delete_volume" :: held 1.863s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['1a7f5c1f-22fe-4315-bffc-d508fe4c9781', '0e6f18a2-54b7-49a8-ac14-4206365d7270', '4b7a9c08-75a0-4a5f-ba3b-814ca6f75da5', 'f3b0c6dc-aa47-489c-8b54-c048b6d9fbf5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:22 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:14:22 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:22 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d" returned: 0 in 0.912s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:22 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 1G
Apr 29 09:14:22 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-9650bcc9-5fe0-434c-b034-7fa91fb15ff2-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-9650bcc9-5fe0-434c-b034-7fa91fb15ff2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "cinder-quobyte-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f541e6cd-7c73-4c7f-871a-3b196866a21e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:23 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:14:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Deleted volume successfully.
Apr 29 09:14:23 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2
Apr 29 09:14:23 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92a4c89-eb9f-422b-bad7-2c1f310312c8 tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-81909a09-9fa7-4938-853c-3b883fba8a1f-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:24 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 1G" returned: 0 in 1.122s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:24 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:24 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:24 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" returned: 0 in 1.052s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:24 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2
Apr 29 09:14:24 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:24 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.777s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:24 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 is being set with open permissions: ugo+rw
Apr 29 09:14:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:24 devstack sudo[90744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:24 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:25 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" returned: 0 in 0.700s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-quobyte-9650bcc9-5fe0-434c-b034-7fa91fb15ff2" released by "delete_volume" :: held 1.855s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Created reservations ['9335254b-d474-4064-908c-ea861a25b45d', 'f76192eb-49c8-495c-b28c-591fd0dd72aa', '0bcf9d99-8f3b-4bc8-b973-5554233a8298', '492a3605-6ffc-41c9-a789-c3ea35a15e28'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:25 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:14:25 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:25 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:25 devstack sudo[90751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.info
Apr 29 09:14:25 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:25 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:14:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Deleted volume successfully.
Apr 29 09:14:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8fa62767-c9c6-404b-8f1f-5be405deb2cb tempest-VolumesSnapshotTestJSON-1223369711 None] Lock "cinder-9650bcc9-5fe0-434c-b034-7fa91fb15ff2-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:26 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.info" returned: 0 in 0.805s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:26 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.info is being set with open permissions: ugo+rw
Apr 29 09:14:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:26 devstack sudo[90755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.info
Apr 29 09:14:26 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:27 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.info" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.240s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aae0d9ee-5e60-4a53-a729-aa9e6707ff36 tempest-SnapshotsActionsTest-604834956 None] Create snapshot completed successfully
Apr 29 09:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Creating offline snapshot ee359cb5-09e4-4c4a-b2f4-f0271245c00f of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:28 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4f3281-364d-48b8-967b-075a856d985e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:28 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:28 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:29 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.996s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:29 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f 1G
Apr 29 09:14:29 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:31 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f 1G" returned: 0 in 1.242s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:31 devstack sudo[90839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f
Apr 29 09:14:31 devstack sudo[90839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:31 devstack sudo[90839]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f" returned: 0 in 0.779s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:31 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f is being set with open permissions: ugo+rw
Apr 29 09:14:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:31 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f
Apr 29 09:14:31 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:32 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Flow 'volume_create_manager' (ba636ee8-e9bc-4527-a104-ffe99b735c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40175b8-7f60-4dbd-9e53-b07a3793bcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f" returned: 0 in 1.045s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40175b8-7f60-4dbd-9e53-b07a3793bcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-128184737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b14afdd-e077-4af2-b799-8d27ac07b716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af66fb33b15d4f2185e199761d17aa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:33Z,use_quota=True,user_id='b33b46777b10455d86b91f545bfa1f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215e1e53-e1e6-44ef-be0a-2fcab67d9f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215e1e53-e1e6-44ef-be0a-2fcab67d9f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09363d7c-c20b-41a2-ac99-e55dfee0fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09363d7c-c20b-41a2-ac99-e55dfee0fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b14afdd-e077-4af2-b799-8d27ac07b716', 'volume_name': 'volume-9b14afdd-e077-4af2-b799-8d27ac07b716', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8731e3e-9379-49a3-935e-8ad1d10830de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8731e3e-9379-49a3-935e-8ad1d10830de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c075127-8759-474c-aeb9-bdfbb69f1f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:32 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Volume 9b14afdd-e077-4af2-b799-8d27ac07b716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b14afdd-e077-4af2-b799-8d27ac07b716', 'volume_size': 1}
Apr 29 09:14:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.240s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-128184737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b14afdd-e077-4af2-b799-8d27ac07b716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af66fb33b15d4f2185e199761d17aa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:33Z,use_quota=True,user_id='b33b46777b10455d86b91f545bfa1f13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Creating volume 9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:14:33 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4d5fccb4-2e4a-4fb0-90a7-83d5727e4378 tempest-SnapshotsActionsTest-604834956 None] Create snapshot completed successfully
Apr 29 09:14:33 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 1073741824
Apr 29 09:14:33 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:33 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 1073741824" returned: 0 in 0.895s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:34 devstack sudo[90868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716
Apr 29 09:14:34 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-ee359cb5-09e4-4c4a-b2f4-f0271245c00f-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-ee359cb5-09e4-4c4a-b2f4-f0271245c00f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-ee359cb5-09e4-4c4a-b2f4-f0271245c00f" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-ee359cb5-09e4-4c4a-b2f4-f0271245c00f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Deleting offline snapshot ee359cb5-09e4-4c4a-b2f4-f0271245c00f of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] snapshot_file for this snap is: volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc3081-8fe2-4ce0-9d3b-0830a5877244]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:34 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f
Apr 29 09:14:34 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:34 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716" returned: 0 in 0.830s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c075127-8759-474c-aeb9-bdfbb69f1f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b14afdd-e077-4af2-b799-8d27ac07b716', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd01d337-d800-4f52-b91a-e70feab00a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Volume volume-9b14afdd-e077-4af2-b799-8d27ac07b716 (9b14afdd-e077-4af2-b799-8d27ac07b716): created successfully
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd01d337-d800-4f52-b91a-e70feab00a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Flow 'volume_create_manager' (ba636ee8-e9bc-4527-a104-ffe99b735c19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:34 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-15efce8c-91ce-4314-9aae-a4a09724fbb4 tempest-VolumesSnapshotListTestJSON-697817164 None] Created volume successfully.
Apr 29 09:14:35 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f" returned: 0 in 0.743s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47412639-2aa8-4953-bbb8-fc1de3288a53]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:35 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:35 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:35 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:35 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f
Apr 29 09:14:35 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Creating offline snapshot 39546b49-e728-4bd8-a489-0a722814efcf of volume 9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[939a822b-7b3b-4fe9-84cf-be49dbf84bf4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:36 devstack sudo[90911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716
Apr 29 09:14:36 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:36 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f" returned: 0 in 0.729s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:36 devstack sudo[90916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f
Apr 29 09:14:36 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:36 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716" returned: 0 in 0.731s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:37 devstack sudo[90921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf 1G
Apr 29 09:14:37 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:37 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.ee359cb5-09e4-4c4a-b2f4-f0271245c00f" returned: 0 in 0.582s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-ee359cb5-09e4-4c4a-b2f4-f0271245c00f" released by "_delete_snapshot" :: held 2.907s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" released by "delete_snapshot" :: held 2.934s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Created reservations ['8b0b5b7d-79ab-4471-857f-d758d3b5b7e3', '71224f1c-f4be-47da-8747-35ed6519001f', '89cd1ef0-929c-4b0a-840d-8f82277e8ac7', '9b4a3eab-8979-4714-8890-b0abe7a66952'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Delete snapshot completed successfully.
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9448a5d9-b856-48ed-b942-06078ef04e05 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-ee359cb5-09e4-4c4a-b2f4-f0271245c00f-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:37 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf 1G" returned: 0 in 0.895s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:37 devstack sudo[90928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf
Apr 29 09:14:37 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:38 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf" returned: 0 in 0.688s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:38 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf is being set with open permissions: ugo+rw
Apr 29 09:14:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:38 devstack sudo[90934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf
Apr 29 09:14:38 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:39 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:39 devstack sudo[90937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.info
Apr 29 09:14:39 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:39 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.info" returned: 0 in 0.647s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:39 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.info is being set with open permissions: ugo+rw
Apr 29 09:14:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:39 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.info
Apr 29 09:14:39 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:40 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.info" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.310s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.741s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:40 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=160,cinder:SELECT=130,cinder:INSERT=44,cinder:DELETE=11 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:14:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Creating offline snapshot bdeeb005-e414-400d-8749-ec81b7bc478b of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b39219-a103-4880-8d30-d3298c4bdd05]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4d496e97-3663-425a-a1a1-a90423353fbd tempest-VolumesSnapshotListTestJSON-697817164 None] Create snapshot completed successfully
Apr 29 09:14:40 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:40 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:41 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.739s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:41 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b 1G
Apr 29 09:14:41 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:42 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b 1G" returned: 0 in 0.796s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:42 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b
Apr 29 09:14:42 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:42 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:42 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b is being set with open permissions: ugo+rw
Apr 29 09:14:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:42 devstack sudo[90963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b
Apr 29 09:14:42 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:43 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b" returned: 0 in 0.589s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:43 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:DELETE=9,cinder:SELECT=139,cinder:UPDATE=152,cinder:INSERT=45 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.892s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.777s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Creating offline snapshot 89139bbd-11be-459a-965f-74e9f45abb59 of volume 9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dec6ae-433e-4c59-b207-ddbadcdd699e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-877f8fd5-af50-40ef-b16f-b9d7bc4a685e tempest-SnapshotsActionsTest-604834956 None] Create snapshot completed successfully
Apr 29 09:14:43 devstack sudo[90967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf
Apr 29 09:14:43 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-bdeeb005-e414-400d-8749-ec81b7bc478b-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-bdeeb005-e414-400d-8749-ec81b7bc478b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:44 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf" returned: 0 in 0.763s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14afdd-e077-4af2-b799-8d27ac07b716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-bdeeb005-e414-400d-8749-ec81b7bc478b" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:44 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 1G
Apr 29 09:14:44 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-bdeeb005-e414-400d-8749-ec81b7bc478b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Deleting offline snapshot bdeeb005-e414-400d-8749-ec81b7bc478b of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] snapshot_file for this snap is: volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4576de-c423-4024-ae22-dab2aaba1e50]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:44 devstack sudo[90975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b
Apr 29 09:14:44 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:45 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 1G" returned: 0 in 0.869s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:45 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b" returned: 0 in 0.813s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:45 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59
Apr 29 09:14:45 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b153b-b6f3-421a-9604-e9d867d2e681]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:45 devstack sudo[90986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:45 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Acquiring lock "cinder-7b63be00-ec38-49bc-8d49-5dc377e531a0-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Lock "cinder-7b63be00-ec38-49bc-8d49-5dc377e531a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Acquiring lock "cinder-quobyte-7b63be00-ec38-49bc-8d49-5dc377e531a0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Lock "cinder-quobyte-7b63be00-ec38-49bc-8d49-5dc377e531a0" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae522444-b8eb-4f07-8de7-d9072982f85b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:45 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:45 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 is being set with open permissions: ugo+rw
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:45 devstack sudo[90995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59
Apr 29 09:14:45 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:45 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0
Apr 29 09:14:45 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:45 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.749s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:45 devstack sudo[90998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b
Apr 29 09:14:45 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:46 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0" returned: 0 in 0.708s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:46 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59" returned: 0 in 0.638s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:46 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0
Apr 29 09:14:46 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fd7950ff-cd6e-479f-9383-1909d3e5259f tempest-VolumesSnapshotListTestJSON-697817164 None] Create snapshot completed successfully
Apr 29 09:14:46 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b" returned: 0 in 0.696s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:46 devstack sudo[91009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b
Apr 29 09:14:46 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Creating offline snapshot 8bf1563b-18b0-425e-9e7b-98b9019d2b8a of volume 9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728d694-279f-40ed-afe5-beaace6a17a3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:47 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7b63be00-ec38-49bc-8d49-5dc377e531a0" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Lock "cinder-quobyte-7b63be00-ec38-49bc-8d49-5dc377e531a0" released by "delete_volume" :: held 1.408s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:47 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.bdeeb005-e414-400d-8749-ec81b7bc478b" returned: 0 in 0.581s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-bdeeb005-e414-400d-8749-ec81b7bc478b" released by "_delete_snapshot" :: held 2.953s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" released by "delete_snapshot" :: held 2.983s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Created reservations ['65b7b443-8f7a-411f-8460-0c6ad564a16d', '3f5dd700-a3f2-4936-a22c-da8b698b90da', '4f91eece-1c7a-4f49-a9d9-18e398ce768d', '5c2fa71a-fdd7-40c7-838a-e945187a8df8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:47 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59
Apr 29 09:14:47 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Created reservations ['0433931c-bf80-4fa0-b6b0-24dc615387dc', '66af9786-a93c-44c5-96a4-de6cffd43bf6', '94dac44d-d92b-48b8-9ecb-6405a4561cfa', '2b7c64fd-020e-4fef-b5fd-1591f3b85eb1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:47 devstack sudo[91015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:14:47 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Delete snapshot completed successfully.
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-5cae28f5-564f-4708-a577-ad02c2d8fefd tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-bdeeb005-e414-400d-8749-ec81b7bc478b-delete_snapshot" released by "delete_snapshot" :: held 3.201s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:47 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59" returned: 0 in 0.737s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14afdd-e077-4af2-b799-8d27ac07b716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:47 devstack sudo[91021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a 1G
Apr 29 09:14:47 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:47 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.583s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:47 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:14:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Deleted volume successfully.
Apr 29 09:14:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a6a97148-adf5-4ed8-a667-34d9fb0acaf6 tempest-VolumesNegativeTest-588370816 None] Lock "cinder-7b63be00-ec38-49bc-8d49-5dc377e531a0-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:48 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a 1G" returned: 0 in 0.949s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:48 devstack sudo[91027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a
Apr 29 09:14:48 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:49 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a" returned: 0 in 0.661s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:49 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a is being set with open permissions: ugo+rw
Apr 29 09:14:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:49 devstack sudo[91032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a
Apr 29 09:14:49 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:50 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a" returned: 0 in 0.567s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.282s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Creating offline snapshot 3a61c787-4d52-482a-a1e0-5f288e531a6c of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-150193b7-574f-4650-ae8b-45b9d3eec0d3 tempest-VolumesSnapshotListTestJSON-697817164 None] Create snapshot completed successfully
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed790bc2-8a86-4994-b929-7480aee97878]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:50 devstack sudo[91035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:50 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Flow 'volume_create_manager' (3aebe879-5de4-458a-ac30-efc0d2df35f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af63097e-f9d9-4314-8e57-4d2b58e72d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af63097e-f9d9-4314-8e57-4d2b58e72d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-174860028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc71b2a7-779b-4f5b-8019-e289bce1bf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8367b8d9e81941d6b591b8525c4da3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:50Z,use_quota=True,user_id='8f08da66221f4dad9a2c704a03b17158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814bc424-f883-4b5f-a7b2-68803fb8bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (814bc424-f883-4b5f-a7b2-68803fb8bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2382f13-74c3-4be6-ab71-58507943459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2382f13-74c3-4be6-ab71-58507943459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc71b2a7-779b-4f5b-8019-e289bce1bf57', 'volume_name': 'volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2575a4-f417-45de-b5bb-f802ed10e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2575a4-f417-45de-b5bb-f802ed10e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fc7b98-9ac3-4be4-b2a2-dfea22b72fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:50 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Volume bc71b2a7-779b-4f5b-8019-e289bce1bf57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57', 'volume_size': 2}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:50 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:50 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c 1G
Apr 29 09:14:50 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:51 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c 1G" returned: 0 in 0.810s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:51 devstack sudo[91046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c
Apr 29 09:14:51 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-8bf1563b-18b0-425e-9e7b-98b9019d2b8a-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-8bf1563b-18b0-425e-9e7b-98b9019d2b8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-quobyte-8bf1563b-18b0-425e-9e7b-98b9019d2b8a" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-8bf1563b-18b0-425e-9e7b-98b9019d2b8a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Deleting offline snapshot 8bf1563b-18b0-425e-9e7b-98b9019d2b8a of volume 9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] snapshot_file for this snap is: volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5d31f0-45b1-47ad-af13-5c87013face5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:52 devstack sudo[91048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a
Apr 29 09:14:52 devstack sudo[91048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:52 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c" returned: 0 in 0.646s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:52 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c is being set with open permissions: ugo+rw
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:52 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c
Apr 29 09:14:52 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:52 devstack sudo[91048]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a" returned: 0 in 0.732s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14afdd-e077-4af2-b799-8d27ac07b716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a626548-29bf-447c-8fb7-4c30e8f6b9da]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:52 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:52 devstack sudo[91059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59
Apr 29 09:14:52 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-174860028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc71b2a7-779b-4f5b-8019-e289bce1bf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8367b8d9e81941d6b591b8525c4da3b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:14:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:14:50Z,use_quota=True,user_id='8f08da66221f4dad9a2c704a03b17158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Creating volume bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:14:53 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 2147483648 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:53 devstack sudo[91061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 2147483648
Apr 29 09:14:53 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ca063af1-57a9-4a38-bdf8-2f8d01df35b4 tempest-SnapshotsActionsTest-604834956 None] Create snapshot completed successfully
Apr 29 09:14:53 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14afdd-e077-4af2-b799-8d27ac07b716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:53 devstack sudo[91069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a
Apr 29 09:14:53 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:53 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 2147483648" returned: 0 in 0.823s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:53 devstack sudo[91071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57
Apr 29 09:14:53 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-3a61c787-4d52-482a-a1e0-5f288e531a6c-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-3a61c787-4d52-482a-a1e0-5f288e531a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-3a61c787-4d52-482a-a1e0-5f288e531a6c" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-3a61c787-4d52-482a-a1e0-5f288e531a6c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Deleting offline snapshot 3a61c787-4d52-482a-a1e0-5f288e531a6c of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] snapshot_file for this snap is: volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e18035-0b75-4bf9-93b5-9ed3f8d794c9]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:54 devstack sudo[91076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c
Apr 29 09:14:54 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:54 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a" returned: 0 in 0.891s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:54 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57" returned: 0 in 0.641s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:54 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a
Apr 29 09:14:54 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fc7b98-9ac3-4be4-b2a2-dfea22b72fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cb1c96-a4df-4416-9294-3e9f1609d609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:14:54 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Volume volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 (bc71b2a7-779b-4f5b-8019-e289bce1bf57): created successfully
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cb1c96-a4df-4416-9294-3e9f1609d609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Flow 'volume_create_manager' (3aebe879-5de4-458a-ac30-efc0d2df35f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:14:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9c1263b5-1a01-44f7-b8f8-39c976e7ddbd tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Created volume successfully.
Apr 29 09:14:54 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c" returned: 0 in 0.744s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da5f09d-0036-4c56-954f-f4f758529837]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:55 devstack sudo[91085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:55 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:55 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.8bf1563b-18b0-425e-9e7b-98b9019d2b8a" returned: 0 in 0.687s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-8bf1563b-18b0-425e-9e7b-98b9019d2b8a" released by "_delete_snapshot" :: held 3.158s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" released by "delete_snapshot" :: held 3.188s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Creating offline snapshot 0a313459-b313-4a19-8389-12dead129a8f of volume bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36711cc-99d9-49a7-865a-e84265823a96]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Created reservations ['e39dc06d-d6a3-4cfd-babe-df96e6808d60', 'f64f1aa7-1c6e-438d-b3a1-2870ac6c082a', '8a3da5e4-8676-47ce-8cf5-2efa3d943027', '9d1ddd80-6e16-468d-89ed-d64cc1a547ac'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Delete snapshot completed successfully.
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e2ec607-d619-4cd8-85d5-7924202a34db tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-8bf1563b-18b0-425e-9e7b-98b9019d2b8a-delete_snapshot" released by "delete_snapshot" :: held 3.375s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:55 devstack sudo[91088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57
Apr 29 09:14:55 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:55 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:55 devstack sudo[91093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c
Apr 29 09:14:55 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:56 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f 2G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:56 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f 2G
Apr 29 09:14:56 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-89139bbd-11be-459a-965f-74e9f45abb59-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-89139bbd-11be-459a-965f-74e9f45abb59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-quobyte-89139bbd-11be-459a-965f-74e9f45abb59" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-89139bbd-11be-459a-965f-74e9f45abb59" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Deleting offline snapshot 89139bbd-11be-459a-965f-74e9f45abb59 of volume 9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] snapshot_file for this snap is: volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a448cb4-8c8c-4b77-b155-8e10c26de863]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:56 devstack sudo[91103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59
Apr 29 09:14:56 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:56 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:56 devstack sudo[91105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c
Apr 29 09:14:56 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:56 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f 2G" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:56 devstack sudo[91110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f
Apr 29 09:14:56 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:57 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14afdd-e077-4af2-b799-8d27ac07b716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98831760-3609-498b-bfd1-8620077607f3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:57 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.3a61c787-4d52-482a-a1e0-5f288e531a6c" returned: 0 in 0.651s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-3a61c787-4d52-482a-a1e0-5f288e531a6c" released by "_delete_snapshot" :: held 3.020s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" released by "delete_snapshot" :: held 3.049s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Created reservations ['828e9b8a-abcd-4698-88d3-dfe0c6dc4fcf', '5dac7992-916b-4d45-9155-f5a1b4db24a4', 'e2b3ba32-b5d3-4cf7-8f91-42735f7d494f', '9340cf7f-6ee4-45ea-8c1f-38fdf5474dff'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:57 devstack sudo[91116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf
Apr 29 09:14:57 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Delete snapshot completed successfully.
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cae00e5a-a45d-4789-af12-4bd1b7355980 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-3a61c787-4d52-482a-a1e0-5f288e531a6c-delete_snapshot" released by "delete_snapshot" :: held 3.220s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:57 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f" returned: 0 in 0.662s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:57 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f is being set with open permissions: ugo+rw
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:57 devstack sudo[91121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f
Apr 29 09:14:57 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:57 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf" returned: 0 in 0.764s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14afdd-e077-4af2-b799-8d27ac07b716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:14:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:57 devstack sudo[91126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59
Apr 29 09:14:57 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:58 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f" returned: 0 in 0.562s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:58 devstack sudo[91129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.info
Apr 29 09:14:58 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:58 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59" returned: 0 in 0.827s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:58 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.info" returned: 0 in 0.667s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:58 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.info is being set with open permissions: ugo+rw
Apr 29 09:14:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:58 devstack sudo[91136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59
Apr 29 09:14:58 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:58 devstack sudo[91137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.info
Apr 29 09:14:58 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:59 devstack sudo[91140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:14:59 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:59 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.89139bbd-11be-459a-965f-74e9f45abb59" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:59 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.info" returned: 0 in 0.598s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.141s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-89139bbd-11be-459a-965f-74e9f45abb59" released by "_delete_snapshot" :: held 3.067s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.704s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" released by "delete_snapshot" :: held 3.109s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Creating offline snapshot 0cf088e5-32c9-4ebc-ad19-51f75e7e843e of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:14:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-26488c4d-ebb0-46af-9a07-9a89e8b9da54 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Create snapshot completed successfully
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8741e4-82f7-4af5-b1eb-1af4b87cb511]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Created reservations ['cdb4f0e6-cbf7-4667-b793-6ec2ea327cd5', 'f5b96543-3656-4d63-8f05-e118a6e1ae23', '44349d7c-3dbf-4b61-af80-04119c7d71b0', 'ba597d6f-9ce1-4c95-9f4a-18807cbc8d9a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:14:59 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Delete snapshot completed successfully.
Apr 29 09:14:59 devstack sudo[91144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:14:59 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0e86469b-6f49-4e61-8a9d-4170e11b99e2 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-89139bbd-11be-459a-965f-74e9f45abb59-delete_snapshot" released by "delete_snapshot" :: held 3.318s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:14:59 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.627s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:14:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:00 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:00 devstack sudo[91150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e 1G
Apr 29 09:15:00 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "cinder-0a313459-b313-4a19-8389-12dead129a8f-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-39546b49-e728-4bd8-a489-0a722814efcf-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-0a313459-b313-4a19-8389-12dead129a8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "cinder-quobyte-bc71b2a7-779b-4f5b-8019-e289bce1bf57" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-39546b49-e728-4bd8-a489-0a722814efcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-quobyte-39546b49-e728-4bd8-a489-0a722814efcf" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-quobyte-bc71b2a7-779b-4f5b-8019-e289bce1bf57" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "cinder-quobyte-0a313459-b313-4a19-8389-12dead129a8f" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-quobyte-0a313459-b313-4a19-8389-12dead129a8f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Deleting offline snapshot 0a313459-b313-4a19-8389-12dead129a8f of volume bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] snapshot_file for this snap is: volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-39546b49-e728-4bd8-a489-0a722814efcf" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Deleting offline snapshot 39546b49-e728-4bd8-a489-0a722814efcf of volume 9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] snapshot_file for this snap is: volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69add50c-decc-41a6-88fb-41664846f93e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f11ef0-0b01-4d44-a260-f1d2c236c4a4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:00 devstack sudo[91152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f
Apr 29 09:15:00 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:00 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf
Apr 29 09:15:00 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:01 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e 1G" returned: 0 in 0.809s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:01 devstack sudo[91159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e
Apr 29 09:15:01 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:01 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a74500-818a-4b9d-b789-de0839689aef]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:01 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b14afdd-e077-4af2-b799-8d27ac07b716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a79f26e-5cab-4c89-8d95-49e940736c65]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:01 devstack sudo[91167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57
Apr 29 09:15:01 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:01 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716
Apr 29 09:15:01 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:01 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:01 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e is being set with open permissions: ugo+rw
Apr 29 09:15:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:01 devstack sudo[91177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e
Apr 29 09:15:01 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:02 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57" returned: 0 in 0.749s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:02 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716" returned: 0 in 0.724s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:02 devstack sudo[91185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f
Apr 29 09:15:02 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:02 devstack sudo[91187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf
Apr 29 09:15:02 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:02 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e" returned: 0 in 0.591s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-99e768f2-bc9b-4875-a699-53c0330ef27e tempest-SnapshotsActionsTest-604834956 None] Create snapshot completed successfully
Apr 29 09:15:02 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf" returned: 0 in 0.671s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:02 devstack sudo[91196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf
Apr 29 09:15:02 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:02 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f" returned: 0 in 0.745s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:02 devstack sudo[91198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f
Apr 29 09:15:02 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-0cf088e5-32c9-4ebc-ad19-51f75e7e843e-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-0cf088e5-32c9-4ebc-ad19-51f75e7e843e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Acquiring lock "cinder-quobyte-0cf088e5-32c9-4ebc-ad19-51f75e7e843e" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-0cf088e5-32c9-4ebc-ad19-51f75e7e843e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Deleting offline snapshot 0cf088e5-32c9-4ebc-ad19-51f75e7e843e of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] snapshot_file for this snap is: volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7728db36-0b95-4094-a907-b760bffe3e54]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:03 devstack sudo[91200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e
Apr 29 09:15:03 devstack sudo[91200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:03 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716.39546b49-e728-4bd8-a489-0a722814efcf" returned: 0 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:03 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57.0a313459-b313-4a19-8389-12dead129a8f" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-39546b49-e728-4bd8-a489-0a722814efcf" released by "_delete_snapshot" :: held 2.884s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" released by "delete_snapshot" :: held 2.967s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-quobyte-0a313459-b313-4a19-8389-12dead129a8f" released by "_delete_snapshot" :: held 2.953s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-quobyte-bc71b2a7-779b-4f5b-8019-e289bce1bf57" released by "delete_snapshot" :: held 2.985s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Created reservations ['f09fcc53-010b-4a49-8bf8-4d4873b1bacf', 'c4e4a597-7a1e-4578-bd51-480d14e9f022', 'e568302a-1078-4ac5-b97b-f5c7b51345e3', 'c5695302-f759-48f8-9c3c-8bb2b56eb103'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Created reservations ['34525828-0c9f-4f44-987a-f06cfb637428', 'c7335fc3-cdcd-4b94-a700-2ddb00ecc537', '21d28d1a-edbf-4e36-ac7e-11e62178189c', 'a68f81ee-b510-4f69-94da-4f3b761dc32e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Delete snapshot completed successfully.
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4e439176-c702-4330-b3eb-03076c600512 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-39546b49-e728-4bd8-a489-0a722814efcf-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Delete snapshot completed successfully.
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-1c9bddb0-0ae5-48f2-8626-8d753490fb7b tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-0a313459-b313-4a19-8389-12dead129a8f-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:03 devstack sudo[91200]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e" returned: 0 in 0.795s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bed64d5-e923-4726-aa34-446d1658ca8d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:04 devstack sudo[91207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:15:04 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:04 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.686s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:04 devstack sudo[91213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e
Apr 29 09:15:04 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-9b14afdd-e077-4af2-b799-8d27ac07b716-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "cinder-bc71b2a7-779b-4f5b-8019-e289bce1bf57-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-9b14afdd-e077-4af2-b799-8d27ac07b716-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-bc71b2a7-779b-4f5b-8019-e289bce1bf57-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "cinder-quobyte-bc71b2a7-779b-4f5b-8019-e289bce1bf57" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-quobyte-bc71b2a7-779b-4f5b-8019-e289bce1bf57" acquired by "delete_volume" :: waited 0.052s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556fa6b-3055-4f8a-93a3-e185eb6fba10]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[139558a8-da3c-42d2-b21f-756be690e915]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:05 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716
Apr 29 09:15:05 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:05 devstack sudo[91216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57
Apr 29 09:15:05 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:05 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e" returned: 0 in 0.739s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:05 devstack sudo[91224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e
Apr 29 09:15:05 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:05 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57" returned: 0 in 0.692s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:05 devstack sudo[91232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57
Apr 29 09:15:05 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:05 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:05 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716
Apr 29 09:15:05 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:05 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.0cf088e5-32c9-4ebc-ad19-51f75e7e843e" returned: 0 in 0.598s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-0cf088e5-32c9-4ebc-ad19-51f75e7e843e" released by "_delete_snapshot" :: held 2.932s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" released by "delete_snapshot" :: held 2.960s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Created reservations ['e227a48b-caa4-4750-a7a0-96d927ab5e72', '4e2270c8-bde4-43b7-8272-d5b2104280e3', '48f630f5-fb4e-4a04-830b-bc16100685a5', '0f30fd1e-f75e-44a3-b0a2-b88428d24b7d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:06 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Delete snapshot completed successfully.
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3933768d-473e-4a5c-ba64-7a2943848a26 tempest-SnapshotsActionsTest-674570733 None] Lock "cinder-0cf088e5-32c9-4ebc-ad19-51f75e7e843e-delete_snapshot" released by "delete_snapshot" :: held 3.117s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:06 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc71b2a7-779b-4f5b-8019-e289bce1bf57" returned: 0 in 0.599s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-quobyte-bc71b2a7-779b-4f5b-8019-e289bce1bf57" released by "delete_volume" :: held 1.346s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Created reservations ['33e97481-09e8-48f9-9d31-f7a590464d7b', 'c1077843-ad67-4f45-8021-e1b0ab6c38c5', '62213ded-773a-4aa8-953b-c2076afc2666', '838f6b6f-ee79-4700-a6ab-3df2411d0ff5'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:06 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9b14afdd-e077-4af2-b799-8d27ac07b716" returned: 0 in 0.645s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-quobyte-9b14afdd-e077-4af2-b799-8d27ac07b716" released by "delete_volume" :: held 1.468s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Created reservations ['6868da75-2dc7-43c8-b054-d0e3a6527c87', 'e5cc09ac-e8f5-4dee-9bfc-ab0d50cb22dd', '2b7f94af-faec-4f8a-84e8-a1d17b87a2fa', 'df8499ef-aa41-4e82-8299-b219e85fe53d'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:06 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:06 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "cinder-c5d74501-d297-4343-9be7-6984ba6fc426-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:06 devstack sudo[91241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:06 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-c5d74501-d297-4343-9be7-6984ba6fc426-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "cinder-quobyte-c5d74501-d297-4343-9be7-6984ba6fc426" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-quobyte-c5d74501-d297-4343-9be7-6984ba6fc426" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Deleting offline snapshot c5d74501-d297-4343-9be7-6984ba6fc426 of volume 95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] snapshot_file for this snap is: volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b960ec-896e-4036-9769-cc896d44aad1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:06 devstack sudo[91245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:15:06 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:07 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Deleted volume successfully.
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3a677b02-ff52-47d5-b759-cd33560f62b1 tempest-VolumesSnapshotNegativeTestJSON-1132634603 None] Lock "cinder-bc71b2a7-779b-4f5b-8019-e289bce1bf57-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:07 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.757s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Deleted volume successfully.
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a1bffe3a-6a54-4af6-a16b-0f89a9e97122 tempest-VolumesSnapshotListTestJSON-697817164 None] Lock "cinder-9b14afdd-e077-4af2-b799-8d27ac07b716-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:07 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.788s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95476fd9-fde2-413f-9608-55d44e60ab4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[39018d46-e67d-4290-9639-4e7bf89e4abc]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:07 devstack sudo[91252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d
Apr 29 09:15:07 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:08 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:08 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:15:08 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:09 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.785s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:09 devstack sudo[91263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426
Apr 29 09:15:09 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:09 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d.c5d74501-d297-4343-9be7-6984ba6fc426" returned: 0 in 0.615s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-quobyte-c5d74501-d297-4343-9be7-6984ba6fc426" released by "_delete_snapshot" :: held 3.059s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" released by "delete_snapshot" :: held 3.084s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Created reservations ['c7b9434b-22ce-47d5-ba11-e94639b841a2', 'bb69498a-ebf2-4761-b7dd-8fc1df318dc3', '088454cf-c4b1-49de-8960-3363872d4338', 'f34c1bec-5b0c-4b50-b464-84693b45562e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Delete snapshot completed successfully.
Apr 29 09:15:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-80c4d8e3-bdf2-4b9e-b126-5dbb81c63793 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-c5d74501-d297-4343-9be7-6984ba6fc426-delete_snapshot" released by "delete_snapshot" :: held 3.240s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (b71674cc-470b-41ff-8f66-21481d9ac852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313cbeff-7fdf-423a-b600-62a4ac32cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313cbeff-7fdf-423a-b600-62a4ac32cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-176906111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91fb2de-984e-4353-9da2-d5ec6882e387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbeb659df184b02aa42410cc8c44053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:10Z,use_quota=True,user_id='161db36e54224029a9940b8ed938ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ee58dd-6aee-4cf4-b4d6-2adcd390c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ee58dd-6aee-4cf4-b4d6-2adcd390c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70622a26-716e-4a98-a7ec-6561c9c56ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70622a26-716e-4a98-a7ec-6561c9c56ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91fb2de-984e-4353-9da2-d5ec6882e387', 'volume_name': 'volume-d91fb2de-984e-4353-9da2-d5ec6882e387', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb23b2d-f056-4411-9c09-4d5a946adc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb23b2d-f056-4411-9c09-4d5a946adc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a053e4-a718-4e55-b2d9-d2f95fd12ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Volume d91fb2de-984e-4353-9da2-d5ec6882e387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91fb2de-984e-4353-9da2-d5ec6882e387', 'volume_size': 1}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-176906111',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91fb2de-984e-4353-9da2-d5ec6882e387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbeb659df184b02aa42410cc8c44053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:10Z,use_quota=True,user_id='161db36e54224029a9940b8ed938ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Creating volume d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:10 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:10 devstack sudo[91266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 1073741824
Apr 29 09:15:10 devstack sudo[91266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (81150775-bf59-42e1-957c-dc3e9079989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a2674d-b506-49b9-aaef-b694c66aad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a2674d-b506-49b9-aaef-b694c66aad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21089093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fb6886-f95c-4794-adb7-409b70a221ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:10Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d311ba-5e67-4fd7-ac02-5a339a4354dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d311ba-5e67-4fd7-ac02-5a339a4354dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fddb1ef-3968-4ea9-b94a-0ccac58a1076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fddb1ef-3968-4ea9-b94a-0ccac58a1076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fb6886-f95c-4794-adb7-409b70a221ca', 'volume_name': 'volume-a9fb6886-f95c-4794-adb7-409b70a221ca', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3dfe14-d564-4881-b6ae-d6f8185c6126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3dfe14-d564-4881-b6ae-d6f8185c6126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca31f63d-7e56-4ded-b803-ff01ac7772ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Volume a9fb6886-f95c-4794-adb7-409b70a221ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fb6886-f95c-4794-adb7-409b70a221ca', 'volume_size': 1}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (dd2cbeb9-c313-4871-94eb-33f368f1d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef65de8-b519-4b7e-affe-94fe0da9f08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef65de8-b519-4b7e-affe-94fe0da9f08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655670298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4295d6d6-c694-44c5-8d0b-237f1e7f9ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:11Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf183372-902e-46a6-b048-aac6534be9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf183372-902e-46a6-b048-aac6534be9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5495a0bd-80ff-433e-a90b-63cecb617f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5495a0bd-80ff-433e-a90b-63cecb617f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4295d6d6-c694-44c5-8d0b-237f1e7f9ed4', 'volume_name': 'volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f13698-5063-430a-8791-1dd6677bdacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f13698-5063-430a-8791-1dd6677bdacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f441b188-db55-4326-9b2c-72a47d2f3c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Volume 4295d6d6-c694-44c5-8d0b-237f1e7f9ed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4', 'volume_size': 1}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "cinder-95476fd9-fde2-413f-9608-55d44e60ab4d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-95476fd9-fde2-413f-9608-55d44e60ab4d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4797c0-8c1c-46ff-963b-3a32717c44e2]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (b802e911-4af4-488c-a177-f56019744870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23de9bd-1b3f-4413-83fd-66c48ca369a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23de9bd-1b3f-4413-83fd-66c48ca369a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506797357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3cacdd-873b-434f-a09a-e3b4361fa20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:11Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d457fa51-92c6-4c9c-9b52-882867318296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d457fa51-92c6-4c9c-9b52-882867318296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b992b8d1-5e83-48ef-9b6c-c543b30e33bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b992b8d1-5e83-48ef-9b6c-c543b30e33bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3cacdd-873b-434f-a09a-e3b4361fa20c', 'volume_name': 'volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba1bb7f-97ed-4127-bd6d-3d55f343da74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba1bb7f-97ed-4127-bd6d-3d55f343da74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e459508-bc08-41a7-a352-85a5b3b446b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Volume 0b3cacdd-873b-434f-a09a-e3b4361fa20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c', 'volume_size': 1}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:11 devstack sudo[91271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d
Apr 29 09:15:11 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:11 devstack sudo[91266]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 1073741824" returned: 0 in 0.909s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:11 devstack sudo[91274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387
Apr 29 09:15:11 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (3a5c727a-0905-41ef-9bca-221b571609d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6165de-c776-434f-8ce1-e9c35d2cb5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6165de-c776-434f-8ce1-e9c35d2cb5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-551455958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c33b07-1ef0-4514-bae6-a177a69b4719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c33b07-1ef0-4514-bae6-a177a69b4719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacbd2b7-e189-4177-bc6e-703d014a0ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacbd2b7-e189-4177-bc6e-703d014a0ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e', 'volume_name': 'volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326ad85f-a977-446f-b88d-0bce08695efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326ad85f-a977-446f-b88d-0bce08695efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec2a3fc-a170-401c-8629-13527fbd8bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Volume 3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e', 'volume_size': 1}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:11 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (7f8f1644-2a5c-475b-9b91-5a50416808d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbe575b-f8e3-4489-b875-4343e0fed2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d" returned: 0 in 0.842s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbe575b-f8e3-4489-b875-4343e0fed2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1841462381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29f37b2-de16-4163-bb17-9e6726cb1c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack sudo[91279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d
Apr 29 09:15:11 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd14519f-0d1b-45a4-9da4-4fd68cdd5854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd14519f-0d1b-45a4-9da4-4fd68cdd5854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc2d713-895f-40ce-aa9b-24864729d4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc2d713-895f-40ce-aa9b-24864729d4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29f37b2-de16-4163-bb17-9e6726cb1c2e', 'volume_name': 'volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34741c6a-aaac-4039-ac0c-9fe49771769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34741c6a-aaac-4039-ac0c-9fe49771769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb9c429-cffc-4e4e-9ebc-147e58e27f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Volume e29f37b2-de16-4163-bb17-9e6726cb1c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e', 'volume_size': 1}
Apr 29 09:15:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:12 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387" returned: 0 in 0.652s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21089093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fb6886-f95c-4794-adb7-409b70a221ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:10Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Creating volume a9fb6886-f95c-4794-adb7-409b70a221ca {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:12 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3a053e4-a718-4e55-b2d9-d2f95fd12ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91fb2de-984e-4353-9da2-d5ec6882e387', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:12 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca 1073741824
Apr 29 09:15:12 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d16c49-afab-48c6-8e4c-b9eb26c94a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Volume volume-d91fb2de-984e-4353-9da2-d5ec6882e387 (d91fb2de-984e-4353-9da2-d5ec6882e387): created successfully
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d16c49-afab-48c6-8e4c-b9eb26c94a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (b71674cc-470b-41ff-8f66-21481d9ac852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f42484f0-634f-4417-8cea-1d81674caf14 tempest-VolumeDependencyTests-373533855 None] Created volume successfully.
Apr 29 09:15:12 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-95476fd9-fde2-413f-9608-55d44e60ab4d" returned: 0 in 0.584s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-quobyte-95476fd9-fde2-413f-9608-55d44e60ab4d" released by "delete_volume" :: held 1.507s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Created reservations ['8ed40b5d-18a3-47b8-b6c1-cc26e2e52111', 'e2373eab-a854-40f8-85dd-7dfa13e31a8e', 'e625787a-285d-45f4-9227-bb598a512f34', '001f8080-8726-4fdf-8845-0f8844d7b607'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:12 devstack sudo[91288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:12 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:12 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca 1073741824" returned: 0 in 0.779s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:12 devstack sudo[91291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca
Apr 29 09:15:12 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:13 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.598s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Deleted volume successfully.
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-027b3c6e-ba25-4dd7-83cf-79cef63a2a05 tempest-SnapshotsActionsTest-604834956 None] Lock "cinder-95476fd9-fde2-413f-9608-55d44e60ab4d-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:13 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.758s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655670298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4295d6d6-c694-44c5-8d0b-237f1e7f9ed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:11Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Creating volume 4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:13 devstack sudo[91295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 1073741824
Apr 29 09:15:13 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca31f63d-7e56-4ded-b803-ff01ac7772ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fb6886-f95c-4794-adb7-409b70a221ca', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee8e988-896d-4a08-9657-cc0060df7136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Volume volume-a9fb6886-f95c-4794-adb7-409b70a221ca (a9fb6886-f95c-4794-adb7-409b70a221ca): created successfully
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee8e988-896d-4a08-9657-cc0060df7136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (81150775-bf59-42e1-957c-dc3e9079989c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4ecd67da-3ffd-4a84-9fe3-6c11355bb0d9 tempest-CreateVolumesFromImageTest-1202893582 None] Created volume successfully.
Apr 29 09:15:14 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 1073741824" returned: 0 in 0.837s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:14 devstack sudo[91302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4
Apr 29 09:15:14 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:15 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4" returned: 0 in 0.627s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.828s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506797357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3cacdd-873b-434f-a09a-e3b4361fa20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:11Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Creating volume 0b3cacdd-873b-434f-a09a-e3b4361fa20c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:15 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f441b188-db55-4326-9b2c-72a47d2f3c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:15 devstack sudo[91305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c 1073741824
Apr 29 09:15:15 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fd4fec-5af2-4c6e-9506-aaf33436e3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:15 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Volume volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 (4295d6d6-c694-44c5-8d0b-237f1e7f9ed4): created successfully
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fd4fec-5af2-4c6e-9506-aaf33436e3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (dd2cbeb9-c313-4871-94eb-33f368f1d354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6e0c09b8-a27c-4c8d-9770-f860923026ab tempest-CreateVolumesFromImageTest-1202893582 None] Created volume successfully.
Apr 29 09:15:15 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c 1073741824" returned: 0 in 0.804s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:15 devstack sudo[91310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c
Apr 29 09:15:15 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:16 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c" returned: 0 in 0.579s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.797s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-551455958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Creating volume 3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:16 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e459508-bc08-41a7-a352-85a5b3b446b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:16 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e 1073741824
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5a75f0-9885-4d54-85e0-4c28fc3eabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:16 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Volume volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c (0b3cacdd-873b-434f-a09a-e3b4361fa20c): created successfully
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa5a75f0-9885-4d54-85e0-4c28fc3eabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (b802e911-4af4-488c-a177-f56019744870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0bdecaa8-cbf3-400a-a8ab-6cfc6ba927d2 tempest-CreateVolumesFromImageTest-1202893582 None] Created volume successfully.
Apr 29 09:15:17 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e 1073741824" returned: 0 in 0.740s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:17 devstack sudo[91319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e
Apr 29 09:15:17 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:17 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e" returned: 0 in 0.597s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.859s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1841462381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29f37b2-de16-4163-bb17-9e6726cb1c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5dcd7a8dee40d196af8353bbb46631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:12Z,use_quota=True,user_id='c35c01e4ac7c4b16b3d4bc9b146eeb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Creating volume e29f37b2-de16-4163-bb17-9e6726cb1c2e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:17 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec2a3fc-a170-401c-8629-13527fbd8bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6916c5f-34c3-41c6-8391-8ad35fa9ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:17 devstack sudo[91322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e 1073741824
Apr 29 09:15:17 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Volume volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e (3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e): created successfully
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6916c5f-34c3-41c6-8391-8ad35fa9ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (3a5c727a-0905-41ef-9bca-221b571609d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1ffa7b0d-0400-4a6d-bb4e-08b07179a400 tempest-CreateVolumesFromImageTest-1202893582 None] Created volume successfully.
Apr 29 09:15:18 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e 1073741824" returned: 0 in 0.932s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:18 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e
Apr 29 09:15:18 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:19 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.778s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb9c429-cffc-4e4e-9ebc-147e58e27f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f387d3b-1d30-4c4c-b6fa-2b94499939e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Creating offline snapshot e875d7da-cea8-44a5-b25b-531fe595d01f of volume d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:15:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Volume volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e (e29f37b2-de16-4163-bb17-9e6726cb1c2e): created successfully
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f387d3b-1d30-4c4c-b6fa-2b94499939e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Flow 'volume_create_manager' (7f8f1644-2a5c-475b-9b91-5a50416808d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[706cc6d3-df91-40e4-adc6-48bc7efe1310]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-17067968-bb63-4e0b-955e-cd92f394202c tempest-CreateVolumesFromImageTest-1202893582 None] Created volume successfully.
Apr 29 09:15:19 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387
Apr 29 09:15:19 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-e29f37b2-de16-4163-bb17-9e6726cb1c2e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-e29f37b2-de16-4163-bb17-9e6726cb1c2e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-quobyte-e29f37b2-de16-4163-bb17-9e6726cb1c2e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-e29f37b2-de16-4163-bb17-9e6726cb1c2e" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb23277-238a-4a1c-a927-2565bace15ed]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:19 devstack sudo[91333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e
Apr 29 09:15:19 devstack sudo[91333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:20 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387" returned: 0 in 0.797s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:20 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f 1G
Apr 29 09:15:20 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:20 devstack sudo[91333]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e" returned: 0 in 0.773s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:20 devstack sudo[91343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e
Apr 29 09:15:20 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:21 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f 1G" returned: 0 in 0.808s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91fb2de-984e-4353-9da2-d5ec6882e387 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:21 devstack sudo[91350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91fb2de-984e-4353-9da2-d5ec6882e387 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f
Apr 29 09:15:21 devstack sudo[91350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:21 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-e29f37b2-de16-4163-bb17-9e6726cb1c2e" returned: 0 in 0.602s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-e29f37b2-de16-4163-bb17-9e6726cb1c2e" released by "delete_volume" :: held 1.426s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Created reservations ['9e7a99ba-c340-4700-b0ce-8eb9fd69f0c6', 'b2af684b-0fc6-4804-a9ff-17156f38d3e7', 'c4a83b64-6b23-4751-a4a3-0ade526ada19', 'ac06f1f6-dddc-44e7-88b3-bd91e14e67a9'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:21 devstack sudo[91352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:21 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:21 devstack sudo[91350]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d91fb2de-984e-4353-9da2-d5ec6882e387 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f" returned: 0 in 0.674s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:21 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f is being set with open permissions: ugo+rw
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:21 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f
Apr 29 09:15:21 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:21 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.671s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:21 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Deleted volume successfully.
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-quobyte-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-fb862554-135c-43bf-8978-2fe0c9d4857d tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-e29f37b2-de16-4163-bb17-9e6726cb1c2e-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20768a-92d4-4ddf-b5b2-b1f46a856c44]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:22 devstack sudo[91372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e
Apr 29 09:15:22 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:22 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f" returned: 0 in 0.798s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:22 devstack sudo[91399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.info
Apr 29 09:15:22 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:22 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e" returned: 0 in 0.788s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:22 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e
Apr 29 09:15:22 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:23 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.info" returned: 0 in 0.613s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:23 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.info is being set with open permissions: ugo+rw
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:23 devstack sudo[91407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.info
Apr 29 09:15:23 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:23 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e" returned: 0 in 0.646s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e" released by "delete_volume" :: held 1.501s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Created reservations ['4e71d982-8cda-49c0-a864-653299e399fe', '71e22497-12ba-431e-b70c-9b6bbd1be572', 'bf5f0de9-dc4f-4b98-b994-fe54a3acb029', 'e2e34edf-c996-4279-9a5d-67dafe77d2aa'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:23 devstack sudo[91416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:23 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:23 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.info" returned: 0 in 0.629s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:23 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9d4a20c0-ff5c-4a7f-9dfa-17de8abfc0ea tempest-VolumeDependencyTests-373533855 None] Create snapshot completed successfully
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-0b3cacdd-873b-434f-a09a-e3b4361fa20c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-0b3cacdd-873b-434f-a09a-e3b4361fa20c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:24 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-quobyte-0b3cacdd-873b-434f-a09a-e3b4361fa20c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Deleted volume successfully.
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-0b3cacdd-873b-434f-a09a-e3b4361fa20c" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-a144bb0c-bfe8-420c-9acd-3c3d70526aa0 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-3dfa44a9-ec41-45db-8cf5-d3f5c27dd11e-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2d017c-ff9e-431c-9fa8-a3ff1f90e377]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:24 devstack sudo[91422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c
Apr 29 09:15:24 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (b2ca2fc5-e947-455b-897b-165f615f4e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f60ffdb-aa70-4ce2-851f-825e837cb343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f60ffdb-aa70-4ce2-851f-825e837cb343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-768206783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c15722-ce18-4470-8124-ff30048f379b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbeb659df184b02aa42410cc8c44053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e875d7da-cea8-44a5-b25b-531fe595d01f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:25Z,use_quota=True,user_id='161db36e54224029a9940b8ed938ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007441df-27d7-4884-8bd4-fcbe6ecc80f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007441df-27d7-4884-8bd4-fcbe6ecc80f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9c2cfd-94c3-4c0b-908c-4bd30ee2254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9c2cfd-94c3-4c0b-908c-4bd30ee2254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '37c15722-ce18-4470-8124-ff30048f379b', 'volume_name': 'volume-37c15722-ce18-4470-8124-ff30048f379b', 'volume_size': 1, 'snapshot_id': 'e875d7da-cea8-44a5-b25b-531fe595d01f'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7661a8ab-f58b-42ca-b88c-20adadc30e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7661a8ab-f58b-42ca-b88c-20adadc30e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7708267c-25c6-47de-945d-2f703a16c6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:24 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Volume 37c15722-ce18-4470-8124-ff30048f379b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-37c15722-ce18-4470-8124-ff30048f379b', 'volume_size': 1, 'snapshot_id': 'e875d7da-cea8-44a5-b25b-531fe595d01f'}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-e875d7da-cea8-44a5-b25b-531fe595d01f-37c15722-ce18-4470-8124-ff30048f379b" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-e875d7da-cea8-44a5-b25b-531fe595d01f-37c15722-ce18-4470-8124-ff30048f379b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Creating volume 37c15722-ce18-4470-8124-ff30048f379b from snapshot e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-37c15722-ce18-4470-8124-ff30048f379b" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-37c15722-ce18-4470-8124-ff30048f379b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] snapshot: e875d7da-cea8-44a5-b25b-531fe595d01f, volume: 37c15722-ce18-4470-8124-ff30048f379b,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f73d31f-69fd-4604-936e-eaf0030f8690]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:25 devstack sudo[91424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f
Apr 29 09:15:25 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:25 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c" returned: 0 in 0.958s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:25 devstack sudo[91430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c
Apr 29 09:15:25 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:25 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f" returned: 0 in 0.854s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91fb2de-984e-4353-9da2-d5ec6882e387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6cce61-ef34-4404-b4c7-15c3cb021563]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:25 devstack sudo[91435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387
Apr 29 09:15:25 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:26 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0b3cacdd-873b-434f-a09a-e3b4361fa20c" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-0b3cacdd-873b-434f-a09a-e3b4361fa20c" released by "delete_volume" :: held 1.672s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Created reservations ['4242dc80-319c-428a-ba18-c18328f651d7', '4cce602d-119f-4e84-a495-f9b848f2b110', 'c31240b1-a6fc-4a30-b446-dacfe2291439', '69753564-4b27-46fb-8254-0e1347bb050a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:26 devstack sudo[91438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:26 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:26 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-quobyte-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387" returned: 0 in 0.821s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:26 devstack sudo[91443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b
Apr 29 09:15:26 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07464d4c-041a-477b-b89c-6f5a39afa9bd]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:26 devstack sudo[91445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4
Apr 29 09:15:26 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:26 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.700s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:26 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Deleted volume successfully.
Apr 29 09:15:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da9efb96-4ef6-4445-a14c-c5393faf905c tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-0b3cacdd-873b-434f-a09a-e3b4361fa20c-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:27 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4" returned: 0 in 0.851s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:27 devstack sudo[91460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4
Apr 29 09:15:27 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:28 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4" returned: 0 in 0.905s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4" released by "delete_volume" :: held 1.844s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Created reservations ['991ccfcf-6589-4f61-bc11-1c01098d6b28', '80b4dea6-09b7-4d28-8bc2-83fa4331ce82', 'fbf2ea68-d014-4b68-9a63-db433a9593a8', '540c0d4e-704b-4f3a-ac1c-51bec2df76d3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:28 devstack sudo[91464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:28 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-a9fb6886-f95c-4794-adb7-409b70a221ca-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-a9fb6886-f95c-4794-adb7-409b70a221ca-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "cinder-quobyte-a9fb6886-f95c-4794-adb7-409b70a221ca" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-a9fb6886-f95c-4794-adb7-409b70a221ca" acquired by "delete_volume" :: waited 0.073s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5c8cd-1c17-41f8-867e-eabd5d36985c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:29 devstack sudo[91466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca
Apr 29 09:15:29 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:30 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.525s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:30 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Deleted volume successfully.
Apr 29 09:15:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0650eac-96eb-4d51-ba54-1ca9dcbfb818 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-4295d6d6-c694-44c5-8d0b-237f1e7f9ed4-delete_volume" released by "delete_volume" :: held 3.763s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:31 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:31 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Flow 'volume_create_manager' (4bec782d-35b8-4f7c-a851-cd15dd703260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64f1bdc-6eec-44d7-bd6c-a3182dc2d98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca" returned: 0 in 2.503s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:32 devstack sudo[91472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca
Apr 29 09:15:32 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64f1bdc-6eec-44d7-bd6c-a3182dc2d98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-392592579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d316e025-0882-4ec6-b023-bde18745c9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0f36a90707486297217bd313965e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:32Z,use_quota=True,user_id='85aa29d598264715a744b6273acb80bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d99989-d23d-42d6-8777-75fc6224ece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d99989-d23d-42d6-8777-75fc6224ece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af82c08-8bfe-469b-917e-bb7db594c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af82c08-8bfe-469b-917e-bb7db594c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd316e025-0882-4ec6-b023-bde18745c9ae', 'volume_name': 'volume-d316e025-0882-4ec6-b023-bde18745c9ae', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38797674-9caf-486f-8ba5-ae72101c245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38797674-9caf-486f-8ba5-ae72101c245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3504746f-bd60-401a-afb1-5b4c7d44156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:32 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Volume d316e025-0882-4ec6-b023-bde18745c9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d316e025-0882-4ec6-b023-bde18745c9ae', 'volume_size': 1}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:32 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b" returned: 0 in 5.584s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa4de1-d296-42be-8916-68d930e9a615]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:32 devstack sudo[91474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387
Apr 29 09:15:32 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:32 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a9fb6886-f95c-4794-adb7-409b70a221ca" returned: 0 in 0.624s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-quobyte-a9fb6886-f95c-4794-adb7-409b70a221ca" released by "delete_volume" :: held 3.241s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Created reservations ['cc940515-5fcb-40bc-b534-d925d670ca36', '5b183be0-07e2-45db-89c4-c58dda4dcb5d', '691a902e-0d11-45d3-b7ee-f81df5958bd1', '9c75067d-ba74-4cbb-9055-13e3c820ec7f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:32 devstack sudo[91477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:32 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:33 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387" returned: 0 in 0.901s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:15:33 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Converted 1024.00 MB image at 183.35 MB/s
Apr 29 09:15:33 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b is being set with open permissions: ugo+rw
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:33 devstack sudo[91482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b
Apr 29 09:15:33 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:33 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.598s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Deleted volume successfully.
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e551bba1-f7bc-49cf-82b5-b3e62bd16010 tempest-CreateVolumesFromImageTest-1202893582 None] Lock "cinder-a9fb6886-f95c-4794-adb7-409b70a221ca-delete_volume" released by "delete_volume" :: held 4.217s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:33 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b" returned: 0 in 0.595s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-37c15722-ce18-4470-8124-ff30048f379b" released by "_copy_volume_from_snapshot" :: held 8.871s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-e875d7da-cea8-44a5-b25b-531fe595d01f-37c15722-ce18-4470-8124-ff30048f379b" released by "_create_volume_from_snapshot" :: held 8.910s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.931s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-392592579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d316e025-0882-4ec6-b023-bde18745c9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0f36a90707486297217bd313965e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:32Z,use_quota=True,user_id='85aa29d598264715a744b6273acb80bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Creating volume d316e025-0882-4ec6-b023-bde18745c9ae {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:33 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:33 devstack sudo[91486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae 1073741824
Apr 29 09:15:33 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7708267c-25c6-47de-945d-2f703a16c6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c15722-ce18-4470-8124-ff30048f379b', 'volume_size': 1, 'snapshot_id': 'e875d7da-cea8-44a5-b25b-531fe595d01f'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0773b42-73a0-428f-9ff1-750abece049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Volume volume-37c15722-ce18-4470-8124-ff30048f379b (37c15722-ce18-4470-8124-ff30048f379b): created successfully
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0773b42-73a0-428f-9ff1-750abece049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (b2ca2fc5-e947-455b-897b-165f615f4e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c03d73dc-bdcc-47d3-b1c6-12a9956cbf90 tempest-VolumeDependencyTests-373533855 None] Created volume successfully.
Apr 29 09:15:34 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae 1073741824" returned: 0 in 0.784s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:34 devstack sudo[91494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae
Apr 29 09:15:34 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-e875d7da-cea8-44a5-b25b-531fe595d01f-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-e875d7da-cea8-44a5-b25b-531fe595d01f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-d91fb2de-984e-4353-9da2-d5ec6882e387" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-d91fb2de-984e-4353-9da2-d5ec6882e387" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-e875d7da-cea8-44a5-b25b-531fe595d01f" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-e875d7da-cea8-44a5-b25b-531fe595d01f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Deleting offline snapshot e875d7da-cea8-44a5-b25b-531fe595d01f of volume d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] snapshot_file for this snap is: volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd810f1-6cb9-4faf-aa2e-f1b23f520e96]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:35 devstack sudo[91496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f
Apr 29 09:15:35 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:35 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae" returned: 0 in 0.620s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3504746f-bd60-401a-afb1-5b4c7d44156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d316e025-0882-4ec6-b023-bde18745c9ae', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590c1d28-3751-4648-bdcc-809a2c2fe030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Volume volume-d316e025-0882-4ec6-b023-bde18745c9ae (d316e025-0882-4ec6-b023-bde18745c9ae): created successfully
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590c1d28-3751-4648-bdcc-809a2c2fe030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Flow 'volume_create_manager' (4bec782d-35b8-4f7c-a851-cd15dd703260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3cdec892-a4a9-4169-b902-43abc7b00c98 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Created volume successfully.
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (a60bb854-f318-4fbb-99d5-573bfb0d7c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe859aa-7958-4844-908f-cfdf2781407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:35 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f" returned: 0 in 0.728s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d91fb2de-984e-4353-9da2-d5ec6882e387(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe859aa-7958-4844-908f-cfdf2781407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776140907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc07e6-b1a5-4356-a624-e5f0574c9417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:36Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea119aee-0e09-4580-a3bb-5c0dcc3017cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea119aee-0e09-4580-a3bb-5c0dcc3017cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6149189-e914-4bac-a682-93f5f206c65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6149189-e914-4bac-a682-93f5f206c65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccdc07e6-b1a5-4356-a624-e5f0574c9417', 'volume_name': 'volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447a81f6-a267-4b0d-af28-53f5266e78a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447a81f6-a267-4b0d-af28-53f5266e78a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd615ebb-b903-45e7-9627-58e0a3323ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume ccdc07e6-b1a5-4356-a624-e5f0574c9417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417', 'volume_size': 1}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776140907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc07e6-b1a5-4356-a624-e5f0574c9417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:36Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Creating volume ccdc07e6-b1a5-4356-a624-e5f0574c9417 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:35 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c386c-cb70-4b88-94f5-4a42dee98644]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:35 devstack sudo[91502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417 1073741824
Apr 29 09:15:35 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:35 devstack sudo[91503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387
Apr 29 09:15:35 devstack sudo[91503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:36 devstack sudo[91503]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387" returned: 0 in 0.729s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:36 devstack sudo[91512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f
Apr 29 09:15:36 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:36 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417 1073741824" returned: 0 in 0.832s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:36 devstack sudo[91514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417
Apr 29 09:15:36 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Acquiring lock "cinder-d316e025-0882-4ec6-b023-bde18745c9ae-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "cinder-d316e025-0882-4ec6-b023-bde18745c9ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Acquiring lock "cinder-quobyte-d316e025-0882-4ec6-b023-bde18745c9ae" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "cinder-quobyte-d316e025-0882-4ec6-b023-bde18745c9ae" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c64c0c-04af-4210-8804-9f67d19f5127]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:37 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f" returned: 0 in 0.765s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:37 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:37 devstack sudo[91522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f
Apr 29 09:15:37 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd615ebb-b903-45e7-9627-58e0a3323ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fa4218-393e-4702-b06e-40ad41423580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:37 devstack sudo[91521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae
Apr 29 09:15:37 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417 (ccdc07e6-b1a5-4356-a624-e5f0574c9417): created successfully
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78fa4218-393e-4702-b06e-40ad41423580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (a60bb854-f318-4fbb-99d5-573bfb0d7c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8393c98b-efb3-4848-a1ff-69617325c423 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created volume successfully.
Apr 29 09:15:37 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387.e875d7da-cea8-44a5-b25b-531fe595d01f" returned: 0 in 0.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-e875d7da-cea8-44a5-b25b-531fe595d01f" released by "_delete_snapshot" :: held 2.955s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:37 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae" returned: 0 in 0.701s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-d91fb2de-984e-4353-9da2-d5ec6882e387" released by "delete_snapshot" :: held 2.996s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:37 devstack sudo[91529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae
Apr 29 09:15:37 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Created reservations ['73918a4e-48a7-467a-aa9d-1577fe9295fc', '55a1c387-6eed-4882-88e8-8109d6690e01', '0d5232b9-e503-4a0b-bd92-b9f1533087f1', '65e59a09-4e1b-49a7-96ff-70853741a9fb'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Delete snapshot completed successfully.
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa1bb227-bdb3-4d7b-8f7c-d48b94d70706 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-e875d7da-cea8-44a5-b25b-531fe595d01f-delete_snapshot" released by "delete_snapshot" :: held 3.191s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (76d59d4f-fc57-4f68-9988-5e56d4c98dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9f8720-8024-43f7-b966-0c1303b72887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9f8720-8024-43f7-b966-0c1303b72887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018266420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a3bf4f-c97e-4305-b648-849b0bc753c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:38Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b551f6db-ba32-4a23-821f-b8c56c7959f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b551f6db-ba32-4a23-821f-b8c56c7959f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30106dc-41a7-470e-9033-e7c8ef7ef06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30106dc-41a7-470e-9033-e7c8ef7ef06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a3bf4f-c97e-4305-b648-849b0bc753c6', 'volume_name': 'volume-37a3bf4f-c97e-4305-b648-849b0bc753c6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba17d11e-c03b-435e-b0c8-47c70edae571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba17d11e-c03b-435e-b0c8-47c70edae571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf21051-7335-48d6-bb72-e2c16b451387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume 37a3bf4f-c97e-4305-b648-849b0bc753c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a3bf4f-c97e-4305-b648-849b0bc753c6', 'volume_size': 1}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2018266420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a3bf4f-c97e-4305-b648-849b0bc753c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:38Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Creating volume 37a3bf4f-c97e-4305-b648-849b0bc753c6 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:38 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:38 devstack sudo[91531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6 1073741824
Apr 29 09:15:38 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (bd82be7f-c100-460d-b67f-453306cca2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7dece4-e7bf-4b76-a5ad-40d31d685f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d316e025-0882-4ec6-b023-bde18745c9ae" returned: 0 in 0.714s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "cinder-quobyte-d316e025-0882-4ec6-b023-bde18745c9ae" released by "delete_volume" :: held 1.472s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7dece4-e7bf-4b76-a5ad-40d31d685f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1423678787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88aa29b6-7d0f-49a9-9fc3-fc16513f293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:39Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bf3963-76a7-4b7c-af95-b7e1bdcabafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bf3963-76a7-4b7c-af95-b7e1bdcabafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce520856-382a-42cd-b39d-5fae7e975cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce520856-382a-42cd-b39d-5fae7e975cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88aa29b6-7d0f-49a9-9fc3-fc16513f293f', 'volume_name': 'volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3f8340-994e-4be2-aebb-313ccab00d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3f8340-994e-4be2-aebb-313ccab00d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a3f89d-2a12-463a-af51-9a809e2e529b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume 88aa29b6-7d0f-49a9-9fc3-fc16513f293f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f', 'volume_size': 1}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Created reservations ['a7b192f0-233a-46be-a065-4297026ec04a', '49199a1c-3415-45d5-aab1-169188e7e8f2', 'e626a092-2bdf-49f9-843e-f90fb2a5696b', 'c595b685-316e-4c67-ad82-0e5fcd4afee3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:38 devstack sudo[91535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:38 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (ebf335c8-f17a-4341-83b0-57c57636a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c020e0-7ccf-47a4-8e24-57f832f49713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c020e0-7ccf-47a4-8e24-57f832f49713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1086235702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:39Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2335fb50-4d86-4f10-832d-1592d27307d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2335fb50-4d86-4f10-832d-1592d27307d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8b4fdf-32bd-4101-a1ed-06f1acba1975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e8b4fdf-32bd-4101-a1ed-06f1acba1975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98', 'volume_name': 'volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d06809-69c7-4213-88ce-c8918616ed04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d06809-69c7-4213-88ce-c8918616ed04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cde0700-3a6c-4b2c-936e-ebc8e8ca23ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume 26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98', 'volume_size': 1}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-d91fb2de-984e-4353-9da2-d5ec6882e387-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-d91fb2de-984e-4353-9da2-d5ec6882e387-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-d91fb2de-984e-4353-9da2-d5ec6882e387" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-d91fb2de-984e-4353-9da2-d5ec6882e387" acquired by "delete_volume" :: waited 0.047s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c46024-c9e9-4ca1-83bc-74493ca8f9e6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:39 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6 1073741824" returned: 0 in 1.083s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (49034bf9-43e0-48c8-8eca-2bbc5744cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:39 devstack sudo[91542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387
Apr 29 09:15:39 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22641f02-7266-48cb-bdc7-448f858fa54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22641f02-7266-48cb-bdc7-448f858fa54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596545046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f5b268-8add-44a8-9c9e-d2b06bc9cae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:39Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b358f45-1f47-4a27-b0a2-f9dae807ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b358f45-1f47-4a27-b0a2-f9dae807ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e31f21-dcde-4bbb-a8f8-d1d0581eb6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e31f21-dcde-4bbb-a8f8-d1d0581eb6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9f5b268-8add-44a8-9c9e-d2b06bc9cae7', 'volume_name': 'volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99f246a-2d41-4f92-8e57-b9f16443d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99f246a-2d41-4f92-8e57-b9f16443d414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b64fee-2ce9-4989-9080-4bdf50e4032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume b9f5b268-8add-44a8-9c9e-d2b06bc9cae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7', 'volume_size': 1}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:39 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:39 devstack sudo[91545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.888s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:39 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Deleted volume successfully.
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8065132f-2996-4281-954c-e4e8e2ccb104 tempest-VolumeQuotasNegativeTestJSON-121247131 None] Lock "cinder-d316e025-0882-4ec6-b023-bde18745c9ae-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (1528886c-75d7-42b5-bcfc-fb75056497d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d189ad-ee10-4309-9901-f458f9acd0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d189ad-ee10-4309-9901-f458f9acd0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148643201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535f79bf-f9e9-43b9-95e3-962485506ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:40Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b71e704-5035-4148-b32e-274912070087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b71e704-5035-4148-b32e-274912070087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dd1d16-a002-44bf-9f7b-42e15ef1c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dd1d16-a002-44bf-9f7b-42e15ef1c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535f79bf-f9e9-43b9-95e3-962485506ed7', 'volume_name': 'volume-535f79bf-f9e9-43b9-95e3-962485506ed7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ead7aa-cef7-4afa-b2a7-97f8820f59f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ead7aa-cef7-4afa-b2a7-97f8820f59f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f312e2a-7552-4329-8155-f41e747a9e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume 535f79bf-f9e9-43b9-95e3-962485506ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535f79bf-f9e9-43b9-95e3-962485506ed7', 'volume_size': 1}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:40 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387" returned: 0 in 0.864s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:40 devstack sudo[91550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387
Apr 29 09:15:40 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:40 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6" returned: 0 in 0.749s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1423678787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88aa29b6-7d0f-49a9-9fc3-fc16513f293f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:39Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Creating volume 88aa29b6-7d0f-49a9-9fc3-fc16513f293f {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:40 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf21051-7335-48d6-bb72-e2c16b451387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a3bf4f-c97e-4305-b648-849b0bc753c6', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d754f54-d4cc-4a94-bfbb-3f8e689b1d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:40 devstack sudo[91553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f 1073741824
Apr 29 09:15:40 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume volume-37a3bf4f-c97e-4305-b648-849b0bc753c6 (37a3bf4f-c97e-4305-b648-849b0bc753c6): created successfully
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d754f54-d4cc-4a94-bfbb-3f8e689b1d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (76d59d4f-fc57-4f68-9988-5e56d4c98dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a5107214-9d17-4046-a53e-15e4b7e920a2 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created volume successfully.
Apr 29 09:15:40 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d91fb2de-984e-4353-9da2-d5ec6882e387" returned: 0 in 0.614s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-d91fb2de-984e-4353-9da2-d5ec6882e387" released by "delete_volume" :: held 1.577s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:40 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=141,cinder:UPDATE=172,cinder:DELETE=16,cinder:INSERT=34 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Created reservations ['74b6408e-eb48-4218-8fbb-e13feca75e9f', 'ab545e44-370d-442f-aa58-e81ae37bca54', 'ba8a6e9e-ff66-454f-8790-9826e0717c13', '68992703-d362-4c74-99a2-1bfc9a23e49a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:41 devstack sudo[91559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:41 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:41 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f 1073741824" returned: 0 in 0.998s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:41 devstack sudo[91564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f
Apr 29 09:15:41 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:41 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.894s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:41 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Deleted volume successfully.
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (57b693a0-5b9d-4f00-8bfb-e34815e47b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169ef87e-27b0-486a-828c-ae515066b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169ef87e-27b0-486a-828c-ae515066b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-266557138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6290aa58-c49e-4e30-a416-ab3c89724a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbeb659df184b02aa42410cc8c44053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:42Z,use_quota=True,user_id='161db36e54224029a9940b8ed938ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0905e74-2fca-463d-a021-f6d3d4f64023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0905e74-2fca-463d-a021-f6d3d4f64023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9a875d-f914-40ca-b16f-05f667d12b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9a875d-f914-40ca-b16f-05f667d12b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6290aa58-c49e-4e30-a416-ab3c89724a18', 'volume_name': 'volume-6290aa58-c49e-4e30-a416-ab3c89724a18', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1527f9e-119e-466c-acf2-18d252e61915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1527f9e-119e-466c-acf2-18d252e61915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3033918d-764e-4e41-b8b7-7445b283b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Volume 6290aa58-c49e-4e30-a416-ab3c89724a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6290aa58-c49e-4e30-a416-ab3c89724a18', 'volume_size': 1}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-66632bfa-1f6e-43b9-8333-e4ec51240306 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-d91fb2de-984e-4353-9da2-d5ec6882e387-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:42 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.256s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1086235702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:39Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Creating volume 26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:42 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a3f89d-2a12-463a-af51-9a809e2e529b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:42 devstack sudo[91568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 1073741824
Apr 29 09:15:42 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c566e6-3bc5-4e4d-bd2b-549bf38e2ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f (88aa29b6-7d0f-49a9-9fc3-fc16513f293f): created successfully
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93c566e6-3bc5-4e4d-bd2b-549bf38e2ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (bd82be7f-c100-460d-b67f-453306cca2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c5ee63a0-bf53-4830-8a60-0632e9185a16 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created volume successfully.
Apr 29 09:15:43 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 1073741824" returned: 0 in 0.779s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:43 devstack sudo[91574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98
Apr 29 09:15:43 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:43 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98" returned: 0 in 0.662s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.094s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596545046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9f5b268-8add-44a8-9c9e-d2b06bc9cae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:39Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Creating volume b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:43 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=187,cinder:SELECT=151,cinder:INSERT=56,cinder:DELETE=12 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:15:43 devstack sudo[91577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 1073741824
Apr 29 09:15:43 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cde0700-3a6c-4b2c-936e-ebc8e8ca23ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac94bd6b-236e-4e86-b5d3-93b162b3732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:43 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 (26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98): created successfully
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac94bd6b-236e-4e86-b5d3-93b162b3732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (ebf335c8-f17a-4341-83b0-57c57636a634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-fdec4877-729f-4706-b55d-0c6e1e4d2629 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created volume successfully.
Apr 29 09:15:44 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 1073741824" returned: 0 in 0.830s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:44 devstack sudo[91584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7
Apr 29 09:15:44 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Flow 'volume_create_manager' (e0672e36-34f3-408e-b0cc-f48358ebe358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b89f03d-83d0-472f-8e42-fe8ce7dcf01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b89f03d-83d0-472f-8e42-fe8ce7dcf01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-619383805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44276ce8-f17a-45e6-8cba-952b911ca647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9163bfe1ce542ad807a7a7105e32d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:45Z,use_quota=True,user_id='c3ab564c508e4b12a6c95ffc54fe8037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d327b8a-4e39-46d5-8bc4-2194bdf0b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d327b8a-4e39-46d5-8bc4-2194bdf0b647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15aae0a-308d-4845-9fed-65f189290ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15aae0a-308d-4845-9fed-65f189290ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44276ce8-f17a-45e6-8cba-952b911ca647', 'volume_name': 'volume-44276ce8-f17a-45e6-8cba-952b911ca647', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1114db4-0875-4102-8172-2d12c1e57cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1114db4-0875-4102-8172-2d12c1e57cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2feff2-d847-44cd-b69e-a410fd50654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Volume 44276ce8-f17a-45e6-8cba-952b911ca647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44276ce8-f17a-45e6-8cba-952b911ca647', 'volume_size': 1}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:45 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7" returned: 0 in 0.593s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.226s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-148643201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535f79bf-f9e9-43b9-95e3-962485506ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c1639027c8e49c9a189868a73e14ea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:40Z,use_quota=True,user_id='0497e951077a48a3beb02388197abf93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Creating volume 535f79bf-f9e9-43b9-95e3-962485506ed7 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:45 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b64fee-2ce9-4989-9080-4bdf50e4032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:45 devstack sudo[91587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7 1073741824
Apr 29 09:15:45 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49534cbf-a5e6-4864-822e-beae40d3d55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 (b9f5b268-8add-44a8-9c9e-d2b06bc9cae7): created successfully
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49534cbf-a5e6-4864-822e-beae40d3d55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (49034bf9-43e0-48c8-8eca-2bbc5744cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6518794f-006f-423d-8419-0e9804fd4cc1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created volume successfully.
Apr 29 09:15:46 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7 1073741824" returned: 0 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:46 devstack sudo[91592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7
Apr 29 09:15:46 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:46 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7" returned: 0 in 0.608s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-266557138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6290aa58-c49e-4e30-a416-ab3c89724a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbeb659df184b02aa42410cc8c44053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:42Z,use_quota=True,user_id='161db36e54224029a9940b8ed938ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Creating volume 6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:46 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f312e2a-7552-4329-8155-f41e747a9e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535f79bf-f9e9-43b9-95e3-962485506ed7', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:46 devstack sudo[91595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 1073741824
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3ee8db-1f23-4d98-9c13-50852f2bcd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:46 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:46 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Volume volume-535f79bf-f9e9-43b9-95e3-962485506ed7 (535f79bf-f9e9-43b9-95e3-962485506ed7): created successfully
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3ee8db-1f23-4d98-9c13-50852f2bcd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:46 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Flow 'volume_create_manager' (1528886c-75d7-42b5-bcfc-fb75056497d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1e860767-1175-49f1-991d-791b5e3d6b78 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created volume successfully.
Apr 29 09:15:47 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 1073741824" returned: 0 in 0.738s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:47 devstack sudo[91600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18
Apr 29 09:15:47 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-535f79bf-f9e9-43b9-95e3-962485506ed7-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-535f79bf-f9e9-43b9-95e3-962485506ed7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-quobyte-535f79bf-f9e9-43b9-95e3-962485506ed7" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-535f79bf-f9e9-43b9-95e3-962485506ed7" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ca7bc-0f24-4ecb-8e50-1a463aacbd73]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:47 devstack sudo[91602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7
Apr 29 09:15:47 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:48 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.833s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-619383805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44276ce8-f17a-45e6-8cba-952b911ca647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9163bfe1ce542ad807a7a7105e32d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:45Z,use_quota=True,user_id='c3ab564c508e4b12a6c95ffc54fe8037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Creating volume 44276ce8-f17a-45e6-8cba-952b911ca647 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:15:48 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3033918d-764e-4e41-b8b7-7445b283b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6290aa58-c49e-4e30-a416-ab3c89724a18', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:48 devstack sudo[91605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647 1073741824
Apr 29 09:15:48 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7385e78f-b679-4006-9a4e-4deba699f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:48 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Volume volume-6290aa58-c49e-4e30-a416-ab3c89724a18 (6290aa58-c49e-4e30-a416-ab3c89724a18): created successfully
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7385e78f-b679-4006-9a4e-4deba699f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (57b693a0-5b9d-4f00-8bfb-e34815e47b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-58f3f8dd-dd2f-4f44-a921-9edd29c3f9c4 tempest-VolumeDependencyTests-373533855 None] Created volume successfully.
Apr 29 09:15:48 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7" returned: 0 in 0.752s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:48 devstack sudo[91610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7
Apr 29 09:15:48 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (68d83058-bb6e-43c3-b5f4-b2f71f323756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c8fa1c-3a56-44c3-b773-6e869f741faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c8fa1c-3a56-44c3-b773-6e869f741faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2034792465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85682874-039a-490f-8e5d-12b93d717e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cbeb659df184b02aa42410cc8c44053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6290aa58-c49e-4e30-a416-ab3c89724a18,status='creating',terminated_at=None,updated_at=2026-04-29T07:15:49Z,use_quota=True,user_id='161db36e54224029a9940b8ed938ae06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:48 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ce425b-c424-46a2-a0c9-6336aeb9f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ce425b-c424-46a2-a0c9-6336aeb9f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:48 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea716bd-06d8-49ac-94e1-b5481dd5ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647 1073741824" returned: 0 in 0.935s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea716bd-06d8-49ac-94e1-b5481dd5ea41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85682874-039a-490f-8e5d-12b93d717e82', 'volume_name': 'volume-85682874-039a-490f-8e5d-12b93d717e82', 'volume_size': 1, 'source_volid': '6290aa58-c49e-4e30-a416-ab3c89724a18', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7144b97f-58a6-454e-b697-c78b2d806da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7144b97f-58a6-454e-b697-c78b2d806da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b15a7c7-da65-48e4-be8f-6d3eefe0045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Volume 85682874-039a-490f-8e5d-12b93d717e82: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85682874-039a-490f-8e5d-12b93d717e82', 'volume_size': 1, 'source_volid': '6290aa58-c49e-4e30-a416-ab3c89724a18', 'source_volstatus': 'available'}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:49 devstack sudo[91617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647
Apr 29 09:15:49 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:49 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-535f79bf-f9e9-43b9-95e3-962485506ed7" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-535f79bf-f9e9-43b9-95e3-962485506ed7" released by "delete_volume" :: held 1.489s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created reservations ['8860b3fb-87b6-4322-9807-2a1427ba5808', 'f8aae712-87c2-464a-aa17-d13954ad3215', '347ca6de-f308-47eb-8717-d587d7c7ba98', 'a4ed3d98-76c1-406f-932a-13565bfdd9b1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:49 devstack sudo[91620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:49 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:49 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647" returned: 0 in 0.613s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.635s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:49 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Cloning volume 6290aa58-c49e-4e30-a416-ab3c89724a18 to volume 85682874-039a-490f-8e5d-12b93d717e82
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2feff2-d847-44cd-b69e-a410fd50654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44276ce8-f17a-45e6-8cba-952b911ca647', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9da156-eb1f-4144-8edc-d9c6be00395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:15:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Volume volume-44276ce8-f17a-45e6-8cba-952b911ca647 (44276ce8-f17a-45e6-8cba-952b911ca647): created successfully
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9da156-eb1f-4144-8edc-d9c6be00395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Flow 'volume_create_manager' (e0672e36-34f3-408e-b0cc-f48358ebe358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Creating offline snapshot 91ef0e0d-d830-41e0-a3b3-254982ddf577 of volume 6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:15:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-636d7a62-7944-41d4-a411-9c1368e8a889 tempest-VolumesServicesTestJSON-721903033 None] Created volume successfully.
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe846f-7f04-4dc5-a67e-04e76ee297af]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:49 devstack sudo[91623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18
Apr 29 09:15:49 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:49 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:49 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Deleted volume successfully.
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-quobyte-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-628d99af-dc55-421b-8e2c-eb29e21b9ec1 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-535f79bf-f9e9-43b9-95e3-962485506ed7-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03494b6-3285-4db9-a48a-2dbdb018814f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:50 devstack sudo[91626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7
Apr 29 09:15:50 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:50 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Acquiring lock "cinder-44276ce8-f17a-45e6-8cba-952b911ca647-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18" returned: 0 in 0.831s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Lock "cinder-44276ce8-f17a-45e6-8cba-952b911ca647-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:50 devstack sudo[91631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 1G
Apr 29 09:15:50 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Acquiring lock "cinder-quobyte-44276ce8-f17a-45e6-8cba-952b911ca647" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Lock "cinder-quobyte-44276ce8-f17a-45e6-8cba-952b911ca647" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddac20a-da55-472a-ac2a-bbde8fafdc94]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:50 devstack sudo[91637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647
Apr 29 09:15:50 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:50 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7" returned: 0 in 0.784s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:50 devstack sudo[91639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7
Apr 29 09:15:50 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:51 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 1G" returned: 0 in 0.816s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6290aa58-c49e-4e30-a416-ab3c89724a18 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:51 devstack sudo[91649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6290aa58-c49e-4e30-a416-ab3c89724a18 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577
Apr 29 09:15:51 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:51 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7" returned: 0 in 0.655s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:51 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647" returned: 0 in 0.791s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7" released by "delete_volume" :: held 1.496s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:51 devstack sudo[91651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647
Apr 29 09:15:51 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created reservations ['bd10c5e7-7fe0-4b54-9a7a-ebb91b77d4c0', '74e5ed94-004a-4c37-a2e6-73623129b1b1', '0e116688-8a32-4d7b-b860-17ec000408e2', '93e458c8-2411-4d51-a6b4-48e7b9c82c73'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:51 devstack sudo[91653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:51 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:52 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6290aa58-c49e-4e30-a416-ab3c89724a18 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577" returned: 0 in 0.689s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:52 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 is being set with open permissions: ugo+rw
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:52 devstack sudo[91659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577
Apr 29 09:15:52 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:52 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:52 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-44276ce8-f17a-45e6-8cba-952b911ca647" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.652s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:52 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Deleted volume successfully.
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Lock "cinder-quobyte-44276ce8-f17a-45e6-8cba-952b911ca647" released by "delete_volume" :: held 1.625s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e739d0ef-76be-41f3-9a90-9f9e4a44e362 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-b9f5b268-8add-44a8-9c9e-d2b06bc9cae7-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-quobyte-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Created reservations ['9da612ff-15be-4ee8-9449-8dda6e92918e', 'a9cbfd8d-2465-46f3-877b-70e05fc0389d', 'b509320e-81b5-402e-b63d-2bc3bceffac9', 'add1f1bd-2005-4b4e-acd2-0ed80305453c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[17231102-b000-45d5-8691-8a5c4bee501a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:52 devstack sudo[91663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:52 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:52 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98
Apr 29 09:15:52 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:52 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:52 devstack sudo[91667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.info
Apr 29 09:15:52 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:53 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.689s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Deleted volume successfully.
Apr 29 09:15:53 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98" returned: 0 in 0.797s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-14ffed11-99f2-4e47-863c-b61024f857cf tempest-VolumesServicesTestJSON-721903033 None] Lock "cinder-44276ce8-f17a-45e6-8cba-952b911ca647-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:53 devstack sudo[91673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98
Apr 29 09:15:53 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:53 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.info" returned: 0 in 0.746s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:53 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.info is being set with open permissions: ugo+rw
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:53 devstack sudo[91676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.info
Apr 29 09:15:53 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:53 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98" released by "delete_volume" :: held 1.448s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created reservations ['60fd8648-ab0a-4193-afbb-f9b80b2094a3', 'ef8b8b1d-f3ab-4506-bce8-00d3f41b6313', 'b0b1848a-1f0d-4178-a8b8-8d4dd92a4bdb', '4087d3cf-e7c9-4aee-94b9-20dcd1f796bc'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:53 devstack sudo[91679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:53 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:54 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.info" returned: 0 in 0.649s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-85682874-039a-490f-8e5d-12b93d717e82" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-85682874-039a-490f-8e5d-12b93d717e82" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] snapshot: 91ef0e0d-d830-41e0-a3b3-254982ddf577, volume: 85682874-039a-490f-8e5d-12b93d717e82,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[500ea2b1-da1c-46c2-8615-eda99d2bda2f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:54 devstack sudo[91682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577
Apr 29 09:15:54 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-88aa29b6-7d0f-49a9-9fc3-fc16513f293f-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-88aa29b6-7d0f-49a9-9fc3-fc16513f293f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-quobyte-88aa29b6-7d0f-49a9-9fc3-fc16513f293f" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-88aa29b6-7d0f-49a9-9fc3-fc16513f293f" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf83af17-9ed4-406b-a93b-341b413155b8]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:54 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Deleted volume successfully.
Apr 29 09:15:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7a77eb3f-8598-4d0a-8001-bd4797db5896 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-26f62ce3-8657-40e0-8c5b-f1f5ce3dbe98-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:54 devstack sudo[91686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f
Apr 29 09:15:54 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:55 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577" returned: 0 in 0.862s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6290aa58-c49e-4e30-a416-ab3c89724a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e1acd4-10b0-4dc3-bedc-b9879f399ef3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:55 devstack sudo[91691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18
Apr 29 09:15:55 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:55 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f" returned: 0 in 0.852s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:55 devstack sudo[91696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f
Apr 29 09:15:55 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:55 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18" returned: 0 in 0.767s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:15:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:55 devstack sudo[91701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82
Apr 29 09:15:55 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:56 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-88aa29b6-7d0f-49a9-9fc3-fc16513f293f" returned: 0 in 0.641s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-88aa29b6-7d0f-49a9-9fc3-fc16513f293f" released by "delete_volume" :: held 1.549s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created reservations ['605b5df8-54ea-4054-8756-5cc156262a98', '4f0abb85-4915-4dbe-826d-41a0425abd91', '10d78486-f2fa-400c-87c8-0d03d1f8ed0d', '12c8a9c6-26c6-4d58-9330-411aaefdaeab'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:56 devstack sudo[91704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:56 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-37a3bf4f-c97e-4305-b648-849b0bc753c6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-37a3bf4f-c97e-4305-b648-849b0bc753c6-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-quobyte-37a3bf4f-c97e-4305-b648-849b0bc753c6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:15:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-37a3bf4f-c97e-4305-b648-849b0bc753c6" acquired by "delete_volume" :: waited 0.037s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:15:57 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.782s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:57 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:15:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Deleted volume successfully.
Apr 29 09:15:57 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52895e7-0ed4-44b8-b659-56cb51772dc6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:15:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:57 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4888f202-110d-4da1-aa32-be50cb6ca49f tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-88aa29b6-7d0f-49a9-9fc3-fc16513f293f-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:57 devstack sudo[91717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6
Apr 29 09:15:57 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:58 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6" returned: 0 in 1.206s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:58 devstack sudo[91723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6
Apr 29 09:15:58 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:15:59 devstack sudo[91725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:15:59 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:15:59 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37a3bf4f-c97e-4305-b648-849b0bc753c6" returned: 0 in 1.272s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-37a3bf4f-c97e-4305-b648-849b0bc753c6" released by "delete_volume" :: held 2.623s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:15:59 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created reservations ['b5343b58-ae14-4507-ab64-3e07240e1a09', 'ef4cb08c-a676-4039-89f9-d7b04f4c96e4', '08fdf70a-d4f3-49dd-b3e1-241b8b247206', '95ea6ffe-a8f7-408c-96e0-197f8ed56096'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:00 devstack sudo[91729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:00 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:00 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.315s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-ccdc07e6-b1a5-4356-a624-e5f0574c9417-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-ccdc07e6-b1a5-4356-a624-e5f0574c9417-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "cinder-quobyte-ccdc07e6-b1a5-4356-a624-e5f0574c9417" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-ccdc07e6-b1a5-4356-a624-e5f0574c9417" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd5aedf-6431-46ee-9923-7a93f62d209d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:00 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.924s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:00 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Deleted volume successfully.
Apr 29 09:16:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-41f51134-b46b-4643-a47d-204f98e56451 tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-37a3bf4f-c97e-4305-b648-849b0bc753c6-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:01 devstack sudo[91732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417
Apr 29 09:16:01 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:01 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417" returned: 0 in 1.074s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:02 devstack sudo[91737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417
Apr 29 09:16:02 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:02 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82" returned: 0 in 6.243s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf0d590-74f5-49d1-a7d2-471a4e878630]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:02 devstack sudo[91739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18
Apr 29 09:16:02 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:02 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ccdc07e6-b1a5-4356-a624-e5f0574c9417" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-quobyte-ccdc07e6-b1a5-4356-a624-e5f0574c9417" released by "delete_volume" :: held 1.863s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Created reservations ['8288c6fa-2b5c-4322-ab01-c25188cb8322', '851ca0fa-ef61-446b-bc44-d57521b90853', '27e61461-566f-486f-a68e-58d9ba202b82', 'fbb2738d-564a-4f14-8c95-25c4e051c53a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:02 devstack sudo[91742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:02 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:03 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18" returned: 0 in 1.043s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:03 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:16:03 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Converted 1024.00 MB image at 163.98 MB/s
Apr 29 09:16:03 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82 is being set with open permissions: ugo+rw
Apr 29 09:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:03 devstack sudo[91747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82
Apr 29 09:16:03 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:03 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:03 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Deleted volume successfully.
Apr 29 09:16:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ebd02c12-c625-4aac-9afa-1c324a9679db tempest-CreateVolumesFromSourceVolumeTest-1475726236 None] Lock "cinder-ccdc07e6-b1a5-4356-a624-e5f0574c9417-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:04 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-85682874-039a-490f-8e5d-12b93d717e82" released by "_copy_volume_from_snapshot" :: held 9.824s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-91ef0e0d-d830-41e0-a3b3-254982ddf577" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-91ef0e0d-d830-41e0-a3b3-254982ddf577" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Deleting offline snapshot 91ef0e0d-d830-41e0-a3b3-254982ddf577 of volume 6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] snapshot_file for this snap is: volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c766cdd3-5ed3-4e45-94ed-f033f242a75c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:04 devstack sudo[91751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577
Apr 29 09:16:04 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:04 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577" returned: 0 in 0.833s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6290aa58-c49e-4e30-a416-ab3c89724a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a62433-f563-4aaa-801d-5ade68c6574f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:05 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18
Apr 29 09:16:05 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:05 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:05 devstack sudo[91762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577
Apr 29 09:16:05 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Flow 'volume_create_manager' (0566693e-7201-44aa-a1df-8f11c6c27152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3396b73-5a68-4459-9786-a7218296fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3396b73-5a68-4459-9786-a7218296fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8c117b-8321-42f1-a51f-238e729ff5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38bd2d378b6470b96f47c96d41c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:06Z,use_quota=True,user_id='74dfa1207dd948a69285a57cee7eec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc71b54-c57e-4c78-9848-08d37176360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc71b54-c57e-4c78-9848-08d37176360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823355f3-cbcd-4e00-8085-d5f418e39902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823355f3-cbcd-4e00-8085-d5f418e39902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a8c117b-8321-42f1-a51f-238e729ff5d2', 'volume_name': 'volume-7a8c117b-8321-42f1-a51f-238e729ff5d2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafc69c5-ccfe-4c70-8668-005a2dbdaa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafc69c5-ccfe-4c70-8668-005a2dbdaa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad45e6a8-c0a7-475c-bd29-6d3bc000e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Volume 7a8c117b-8321-42f1-a51f-238e729ff5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a8c117b-8321-42f1-a51f-238e729ff5d2', 'volume_size': 1}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Flow 'volume_create_manager' (45f68d3c-304a-4fab-b00f-4b7438ee1aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8f8068-045e-4bcd-b4d3-891e6d4985ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8f8068-045e-4bcd-b4d3-891e6d4985ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2050493590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83183f30054d40a3808bec4133d1db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:06Z,use_quota=True,user_id='8843a6cfe15746498ccd9bc7899e5c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966ccb42-91b4-4091-aa9e-536754e69955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966ccb42-91b4-4091-aa9e-536754e69955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823a573b-e3ad-4309-a46c-bcd7f7fea1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823a573b-e3ad-4309-a46c-bcd7f7fea1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e', 'volume_name': 'volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026123dc-b250-4405-85cf-ef0e0e30559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026123dc-b250-4405-85cf-ef0e0e30559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1878b07e-7e95-44cf-b7a6-73e2224e7964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:06 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Volume cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e', 'volume_size': 1}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577" returned: 0 in 0.721s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:06 devstack sudo[91768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577
Apr 29 09:16:06 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:07 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18.91ef0e0d-d830-41e0-a3b3-254982ddf577" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-91ef0e0d-d830-41e0-a3b3-254982ddf577" released by "_delete_snapshot" :: held 2.995s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.429s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.778s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a8c117b-8321-42f1-a51f-238e729ff5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38bd2d378b6470b96f47c96d41c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:06Z,use_quota=True,user_id='74dfa1207dd948a69285a57cee7eec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Creating volume 7a8c117b-8321-42f1-a51f-238e729ff5d2 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:07 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b15a7c7-da65-48e4-be8f-6d3eefe0045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85682874-039a-490f-8e5d-12b93d717e82', 'volume_size': 1, 'source_volid': '6290aa58-c49e-4e30-a416-ab3c89724a18', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:07 devstack sudo[91771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2 1073741824
Apr 29 09:16:07 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e1b84d-40c6-4bff-8403-1a914653dbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:07 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Volume volume-85682874-039a-490f-8e5d-12b93d717e82 (85682874-039a-490f-8e5d-12b93d717e82): created successfully
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e1b84d-40c6-4bff-8403-1a914653dbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Flow 'volume_create_manager' (68d83058-bb6e-43c3-b5f4-b2f71f323756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-281277b2-6b6a-4542-8358-00fe30791061 tempest-VolumeDependencyTests-373533855 None] Created volume successfully.
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-6290aa58-c49e-4e30-a416-ab3c89724a18-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Lock "cinder-6290aa58-c49e-4e30-a416-ab3c89724a18-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-6290aa58-c49e-4e30-a416-ab3c89724a18" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-6290aa58-c49e-4e30-a416-ab3c89724a18" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7540d283-4c85-4e2f-8cde-992de5f85482]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:07 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18
Apr 29 09:16:07 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:07 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2 1073741824" returned: 0 in 0.811s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:08 devstack sudo[91778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2
Apr 29 09:16:08 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:08 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18" returned: 0 in 0.704s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:08 devstack sudo[91783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18
Apr 29 09:16:08 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:08 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.173s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2050493590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83183f30054d40a3808bec4133d1db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:06Z,use_quota=True,user_id='8843a6cfe15746498ccd9bc7899e5c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Creating volume cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:08 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:08 devstack sudo[91786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e 1073741824
Apr 29 09:16:08 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad45e6a8-c0a7-475c-bd29-6d3bc000e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a8c117b-8321-42f1-a51f-238e729ff5d2', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4c4310-8f5f-4696-ae7f-6e0747fe0786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:08 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Volume volume-7a8c117b-8321-42f1-a51f-238e729ff5d2 (7a8c117b-8321-42f1-a51f-238e729ff5d2): created successfully
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4c4310-8f5f-4696-ae7f-6e0747fe0786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Flow 'volume_create_manager' (0566693e-7201-44aa-a1df-8f11c6c27152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-97f01f3e-cf9b-4ad4-97db-213b8f4dc477 tempest-CinderUnicodeTest-309830440 None] Created volume successfully.
Apr 29 09:16:08 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6290aa58-c49e-4e30-a416-ab3c89724a18" returned: 0 in 0.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-6290aa58-c49e-4e30-a416-ab3c89724a18" released by "delete_volume" :: held 1.331s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Created reservations ['2944733b-38ba-43ab-89f4-571dcf0580ab', '852ccca4-f06a-49f6-ad8e-53be37cbb815', 'fe121888-c578-4756-97e2-d93580b19746', 'dd278682-8152-4606-8645-95abb40a1bd1'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:09 devstack sudo[91789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:09 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:09 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e 1073741824" returned: 0 in 0.839s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:09 devstack sudo[91794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e
Apr 29 09:16:09 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:09 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.627s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Deleted volume successfully.
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-7d6c0413-3927-4f28-81d6-a7aaefbc5fac tempest-VolumeDependencyTests-373533855 None] Lock "cinder-6290aa58-c49e-4e30-a416-ab3c89724a18-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-85682874-039a-490f-8e5d-12b93d717e82-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-85682874-039a-490f-8e5d-12b93d717e82-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-85682874-039a-490f-8e5d-12b93d717e82" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-85682874-039a-490f-8e5d-12b93d717e82" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Flow 'volume_create_manager' (ee37c93f-3781-4f04-aa43-9c2f1576a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d32129-8599-4634-a990-746e99f41553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7013246d-008b-44fe-b13c-811644844440]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d32129-8599-4634-a990-746e99f41553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1241778496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05700516-e5a8-4084-980c-0d295cae1d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38bd2d378b6470b96f47c96d41c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:10Z,use_quota=True,user_id='74dfa1207dd948a69285a57cee7eec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b513e5-8a78-4ff1-9377-b1287cd5b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b513e5-8a78-4ff1-9377-b1287cd5b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ced3dd7-622d-452d-a23d-83c6c64dc946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ced3dd7-622d-452d-a23d-83c6c64dc946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05700516-e5a8-4084-980c-0d295cae1d59', 'volume_name': 'volume-05700516-e5a8-4084-980c-0d295cae1d59', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b48e2b-0755-4372-aaf9-6cafe56f42b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b48e2b-0755-4372-aaf9-6cafe56f42b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c8f74-40ce-4417-92a8-d501d4e8179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Volume 05700516-e5a8-4084-980c-0d295cae1d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05700516-e5a8-4084-980c-0d295cae1d59', 'volume_size': 1}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:10 devstack sudo[91797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82
Apr 29 09:16:10 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:10 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e" returned: 0 in 0.687s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1241778496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05700516-e5a8-4084-980c-0d295cae1d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e38bd2d378b6470b96f47c96d41c607b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:10Z,use_quota=True,user_id='74dfa1207dd948a69285a57cee7eec87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Creating volume 05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:10 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1878b07e-7e95-44cf-b7a6-73e2224e7964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:10 devstack sudo[91800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 1073741824
Apr 29 09:16:10 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8395aa92-072e-4d40-811d-a9986070f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:10 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Volume volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e (cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e): created successfully
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8395aa92-072e-4d40-811d-a9986070f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Flow 'volume_create_manager' (45f68d3c-304a-4fab-b00f-4b7438ee1aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-42cfc98e-728b-4977-9fef-17c1a771ac22 tempest-VolumesListAdminTestJSON-1068322316 None] Created volume successfully.
Apr 29 09:16:10 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82" returned: 0 in 0.804s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:10 devstack sudo[91808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82
Apr 29 09:16:10 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:10 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Flow 'volume_create_manager' (682962df-06eb-492c-82f1-d73c4e88cdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707cdf78-f861-4da0-bc56-8fd3ee9111fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707cdf78-f861-4da0-bc56-8fd3ee9111fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1934844676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660f6e7e-f135-4db7-a635-d15316f6d076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83183f30054d40a3808bec4133d1db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:11Z,use_quota=True,user_id='8843a6cfe15746498ccd9bc7899e5c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21be629a-af98-4bad-a706-ce9032114ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21be629a-af98-4bad-a706-ce9032114ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab731e8f-1e6b-4bc3-bd94-b1165dd50cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab731e8f-1e6b-4bc3-bd94-b1165dd50cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660f6e7e-f135-4db7-a635-d15316f6d076', 'volume_name': 'volume-660f6e7e-f135-4db7-a635-d15316f6d076', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2587532-6210-4573-883b-8b2b2b25e1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2587532-6210-4573-883b-8b2b2b25e1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0670a002-2a17-48c3-816a-4b885ec83f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Volume 660f6e7e-f135-4db7-a635-d15316f6d076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660f6e7e-f135-4db7-a635-d15316f6d076', 'volume_size': 1}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:11 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 1073741824" returned: 0 in 0.887s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:11 devstack sudo[91811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59
Apr 29 09:16:11 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:11 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-85682874-039a-490f-8e5d-12b93d717e82" returned: 0 in 0.644s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-85682874-039a-490f-8e5d-12b93d717e82" released by "delete_volume" :: held 1.513s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Created reservations ['31838a33-c2de-4de0-aebf-4e310b6af28f', '1c4c16e1-5a60-468d-82d5-f64163e4e200', 'ac8bb9e4-1720-4e84-9aec-723fda485d0a', 'ec17d48c-a8ed-4a4d-8ec3-a2c5a3dde423'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:11 devstack sudo[91814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:11 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:11 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59" returned: 0 in 0.591s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1934844676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660f6e7e-f135-4db7-a635-d15316f6d076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83183f30054d40a3808bec4133d1db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:11Z,use_quota=True,user_id='8843a6cfe15746498ccd9bc7899e5c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Creating volume 660f6e7e-f135-4db7-a635-d15316f6d076 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:11 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:11 devstack sudo[91817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076 1073741824
Apr 29 09:16:11 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c8f74-40ce-4417-92a8-d501d4e8179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05700516-e5a8-4084-980c-0d295cae1d59', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f178773c-eee7-4aad-a872-3d7cef399456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Volume volume-05700516-e5a8-4084-980c-0d295cae1d59 (05700516-e5a8-4084-980c-0d295cae1d59): created successfully
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f178773c-eee7-4aad-a872-3d7cef399456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Flow 'volume_create_manager' (ee37c93f-3781-4f04-aa43-9c2f1576a33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:11 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-42852682-412b-46b4-a6d3-127c56d6bed8 tempest-CinderUnicodeTest-309830440 None] Created volume successfully.
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-37c15722-ce18-4470-8124-ff30048f379b-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Lock "cinder-37c15722-ce18-4470-8124-ff30048f379b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Acquiring lock "cinder-quobyte-37c15722-ce18-4470-8124-ff30048f379b" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-37c15722-ce18-4470-8124-ff30048f379b" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:12 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.768s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e8cfdf-052f-4293-a2c4-0734552bc6aa]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Deleted volume successfully.
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-da370663-ed8c-4192-a803-99711ebd7b36 tempest-VolumeDependencyTests-373533855 None] Lock "cinder-85682874-039a-490f-8e5d-12b93d717e82-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:12 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b
Apr 29 09:16:12 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:12 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076 1073741824" returned: 0 in 0.832s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:12 devstack sudo[91825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076
Apr 29 09:16:12 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:13 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:13 devstack sudo[91830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b
Apr 29 09:16:13 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:13 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076" returned: 0 in 0.619s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.874s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Creating offline snapshot 18d0a485-ffc1-43d7-820e-20edfe62dd1a of volume 05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0670a002-2a17-48c3-816a-4b885ec83f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660f6e7e-f135-4db7-a635-d15316f6d076', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c54c9e-0c2a-45b4-8d03-829512a99272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c7669-d141-4ff5-ad1a-0802648089db]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Volume volume-660f6e7e-f135-4db7-a635-d15316f6d076 (660f6e7e-f135-4db7-a635-d15316f6d076): created successfully
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c54c9e-0c2a-45b4-8d03-829512a99272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Flow 'volume_create_manager' (682962df-06eb-492c-82f1-d73c4e88cdb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8e15f210-19b8-4042-84d2-6cadb5dc5cc4 tempest-VolumesListAdminTestJSON-1068322316 None] Created volume successfully.
Apr 29 09:16:13 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59
Apr 29 09:16:13 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:13 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-37c15722-ce18-4470-8124-ff30048f379b" returned: 0 in 0.617s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Lock "cinder-quobyte-37c15722-ce18-4470-8124-ff30048f379b" released by "delete_volume" :: held 1.398s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Created reservations ['0ab3b0e8-6d01-4a5c-9661-bf1af12bb847', 'd53ad129-2ade-4538-befb-65feeeb97062', '8edaeeea-40ff-490e-b2e8-87428b48f107', 'b8b11784-e1ba-471d-bf84-8cf7beb81b7a'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:13 devstack sudo[91836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:13 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:14 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59" returned: 0 in 0.758s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:14 devstack sudo[91841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a 1G
Apr 29 09:16:14 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:14 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Deleted volume successfully.
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9dd20a9f-c826-42d3-9ec1-9806621c73ab tempest-VolumeDependencyTests-373533855 None] Lock "cinder-37c15722-ce18-4470-8124-ff30048f379b-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Flow 'volume_create_manager' (2067ae22-555e-49d1-8278-4ee51a38ac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f97a035-db89-4dd5-8f48-92cd865e4ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f97a035-db89-4dd5-8f48-92cd865e4ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-602979402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11ae737-352c-423c-9684-95759887db8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83183f30054d40a3808bec4133d1db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:15Z,use_quota=True,user_id='8843a6cfe15746498ccd9bc7899e5c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb148246-24b8-4299-8d9b-f6cc86b8ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb148246-24b8-4299-8d9b-f6cc86b8ab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5bdb8d-0d1d-4b1b-9296-574e4744ad90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca5bdb8d-0d1d-4b1b-9296-574e4744ad90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11ae737-352c-423c-9684-95759887db8f', 'volume_name': 'volume-a11ae737-352c-423c-9684-95759887db8f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b509b6-3dc8-4033-bd6e-5ea8aef6cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b509b6-3dc8-4033-bd6e-5ea8aef6cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5d7709-3851-4586-8046-618e42d3da81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Volume a11ae737-352c-423c-9684-95759887db8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11ae737-352c-423c-9684-95759887db8f', 'volume_size': 1}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:14 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a 1G" returned: 0 in 0.929s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05700516-e5a8-4084-980c-0d295cae1d59 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:14 devstack sudo[91849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05700516-e5a8-4084-980c-0d295cae1d59 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a
Apr 29 09:16:14 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:15 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05700516-e5a8-4084-980c-0d295cae1d59 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:15 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a is being set with open permissions: ugo+rw
Apr 29 09:16:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:15 devstack sudo[91854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a
Apr 29 09:16:15 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:16 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:16 devstack sudo[91857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.info
Apr 29 09:16:16 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:16 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.info" returned: 0 in 0.576s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:16 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.info is being set with open permissions: ugo+rw
Apr 29 09:16:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:16 devstack sudo[91860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.info
Apr 29 09:16:16 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:17 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.info" returned: 0 in 0.551s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-602979402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a11ae737-352c-423c-9684-95759887db8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83183f30054d40a3808bec4133d1db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:15Z,use_quota=True,user_id='8843a6cfe15746498ccd9bc7899e5c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Creating volume a11ae737-352c-423c-9684-95759887db8f {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:17 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:17 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f 1073741824
Apr 29 09:16:17 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1577c79f-efa7-4f3c-8413-0d0aa032e489 tempest-CinderUnicodeTest-309830440 None] Create snapshot completed successfully
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "cinder-18d0a485-ffc1-43d7-820e-20edfe62dd1a-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Lock "cinder-18d0a485-ffc1-43d7-820e-20edfe62dd1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "cinder-quobyte-05700516-e5a8-4084-980c-0d295cae1d59" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-05700516-e5a8-4084-980c-0d295cae1d59" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Acquiring lock "cinder-quobyte-18d0a485-ffc1-43d7-820e-20edfe62dd1a" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-18d0a485-ffc1-43d7-820e-20edfe62dd1a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Deleting offline snapshot 18d0a485-ffc1-43d7-820e-20edfe62dd1a of volume 05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] snapshot_file for this snap is: volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e532d6-75a1-4908-8f1b-a8c82173a364]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:17 devstack sudo[91865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a
Apr 29 09:16:17 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:18 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f 1073741824" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:18 devstack sudo[91870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f
Apr 29 09:16:18 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:18 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a" returned: 0 in 0.713s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05700516-e5a8-4084-980c-0d295cae1d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7826a234-4b6a-4f9c-b5cf-fe275a2a63ab]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:18 devstack sudo[91875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59
Apr 29 09:16:18 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:18 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f" returned: 0 in 0.619s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5d7709-3851-4586-8046-618e42d3da81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11ae737-352c-423c-9684-95759887db8f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85a5779-0fa4-40e2-9ed0-c7aceb2c696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Volume volume-a11ae737-352c-423c-9684-95759887db8f (a11ae737-352c-423c-9684-95759887db8f): created successfully
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85a5779-0fa4-40e2-9ed0-c7aceb2c696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Flow 'volume_create_manager' (2067ae22-555e-49d1-8278-4ee51a38ac73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-47cc349f-2982-4d64-ac1b-d04ebf7a08ba tempest-VolumesListAdminTestJSON-1068322316 None] Created volume successfully.
Apr 29 09:16:19 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59" returned: 0 in 0.673s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:19 devstack sudo[91881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a
Apr 29 09:16:19 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:19 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:19 devstack sudo[91886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a
Apr 29 09:16:19 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:20 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59.18d0a485-ffc1-43d7-820e-20edfe62dd1a" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-18d0a485-ffc1-43d7-820e-20edfe62dd1a" released by "_delete_snapshot" :: held 2.765s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-05700516-e5a8-4084-980c-0d295cae1d59" released by "delete_snapshot" :: held 2.788s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Created reservations ['3ea4d9bb-21ff-4349-b44a-2a2df49713dd', '0a7860da-fd03-4630-a43c-088ef3483469', 'c64fc045-15f4-4c75-96fc-bdef8687511e', 'ecca2835-a78d-4840-a177-e701bb2a2ded'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Delete snapshot completed successfully.
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-0f7163de-9781-469c-b00f-052858170145 tempest-CinderUnicodeTest-309830440 None] Lock "cinder-18d0a485-ffc1-43d7-820e-20edfe62dd1a-delete_snapshot" released by "delete_snapshot" :: held 2.929s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Flow 'volume_create_manager' (fd91fe4f-828d-45bd-8a7b-b877b9056e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76df2a02-5092-438e-bb8b-1b4817f0ddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76df2a02-5092-438e-bb8b-1b4817f0ddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b03a38-8456-4993-842e-30d84a66d0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5631210ecf754f2397737c827d62adfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:21Z,use_quota=True,user_id='5bdff47fea8e40bfbb0f88161a800066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e42506-0f05-49f3-b26d-577a7fb1d937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e42506-0f05-49f3-b26d-577a7fb1d937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1238b312-1725-4eb6-9b3b-13ffdcfd1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1238b312-1725-4eb6-9b3b-13ffdcfd1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b03a38-8456-4993-842e-30d84a66d0bd', 'volume_name': 'volume-20b03a38-8456-4993-842e-30d84a66d0bd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b61333-5432-40f8-bdca-dfb4c1d6bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b61333-5432-40f8-bdca-dfb4c1d6bef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f8bffc-afff-4d89-b21b-8b296cf368dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:20 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Volume 20b03a38-8456-4993-842e-30d84a66d0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b03a38-8456-4993-842e-30d84a66d0bd', 'volume_size': 1}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b03a38-8456-4993-842e-30d84a66d0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5631210ecf754f2397737c827d62adfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:21Z,use_quota=True,user_id='5bdff47fea8e40bfbb0f88161a800066',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Creating volume 20b03a38-8456-4993-842e-30d84a66d0bd {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:20 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:20 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd 1073741824
Apr 29 09:16:20 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Acquiring lock "cinder-05700516-e5a8-4084-980c-0d295cae1d59-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Lock "cinder-05700516-e5a8-4084-980c-0d295cae1d59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Acquiring lock "cinder-quobyte-05700516-e5a8-4084-980c-0d295cae1d59" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-05700516-e5a8-4084-980c-0d295cae1d59" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[92680381-1fb9-4ccb-a96e-dc1f4e0cfd3f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:20 devstack sudo[91891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59
Apr 29 09:16:20 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:21 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd 1073741824" returned: 0 in 0.769s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:21 devstack sudo[91899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd
Apr 29 09:16:21 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:21 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:21 devstack sudo[91902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59
Apr 29 09:16:21 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:22 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f8bffc-afff-4d89-b21b-8b296cf368dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b03a38-8456-4993-842e-30d84a66d0bd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb86946-195a-46ca-9a31-2e4c78b56b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:22 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Volume volume-20b03a38-8456-4993-842e-30d84a66d0bd (20b03a38-8456-4993-842e-30d84a66d0bd): created successfully
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb86946-195a-46ca-9a31-2e4c78b56b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Flow 'volume_create_manager' (fd91fe4f-828d-45bd-8a7b-b877b9056e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c3ef778c-e8cb-4896-8542-3e5f051b547a tempest-VolumesListAdminTestJSON-717341280 None] Created volume successfully.
Apr 29 09:16:22 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-05700516-e5a8-4084-980c-0d295cae1d59" returned: 0 in 0.609s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-05700516-e5a8-4084-980c-0d295cae1d59" released by "delete_volume" :: held 1.417s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Created reservations ['03825306-fcd2-43aa-a663-63760792d256', '45b599a1-3b79-4c16-b5b1-2cfca4e2c368', '1dddb444-6905-4189-817c-77899e61b1bd', 'ebdc8b9c-5978-4798-b18b-cfcfa338d983'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:22 devstack sudo[91906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:22 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Acquiring lock "cinder-20b03a38-8456-4993-842e-30d84a66d0bd-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Lock "cinder-20b03a38-8456-4993-842e-30d84a66d0bd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Acquiring lock "cinder-quobyte-20b03a38-8456-4993-842e-30d84a66d0bd" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:22 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.589s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Deleted volume successfully.
Apr 29 09:16:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Lock "cinder-quobyte-20b03a38-8456-4993-842e-30d84a66d0bd" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-988f8942-fb0c-45ec-8bc7-431b8ee4908f tempest-CinderUnicodeTest-309830440 None] Lock "cinder-05700516-e5a8-4084-980c-0d295cae1d59-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Acquiring lock "cinder-7a8c117b-8321-42f1-a51f-238e729ff5d2-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Lock "cinder-7a8c117b-8321-42f1-a51f-238e729ff5d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a647e249-f7f1-4983-a2f6-99ff9db33372]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "cinder-a11ae737-352c-423c-9684-95759887db8f-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-a11ae737-352c-423c-9684-95759887db8f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Acquiring lock "cinder-quobyte-7a8c117b-8321-42f1-a51f-238e729ff5d2" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-7a8c117b-8321-42f1-a51f-238e729ff5d2" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "cinder-quobyte-a11ae737-352c-423c-9684-95759887db8f" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69048862-13e7-4031-9aea-4f42f3ceef19]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-quobyte-a11ae737-352c-423c-9684-95759887db8f" acquired by "delete_volume" :: waited 0.028s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fcd633-0b42-46d3-9c20-caf900e314e5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:23 devstack sudo[91945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd
Apr 29 09:16:23 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:23 devstack sudo[91946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2
Apr 29 09:16:23 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:23 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f
Apr 29 09:16:23 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:23 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd" returned: 0 in 0.815s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:23 devstack sudo[91967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd
Apr 29 09:16:23 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:23 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2" returned: 0 in 0.755s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:23 devstack sudo[91969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2
Apr 29 09:16:23 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:24 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f" returned: 0 in 0.780s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:24 devstack sudo[91971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f
Apr 29 09:16:24 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:24 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-20b03a38-8456-4993-842e-30d84a66d0bd" returned: 0 in 0.693s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Lock "cinder-quobyte-20b03a38-8456-4993-842e-30d84a66d0bd" released by "delete_volume" :: held 1.586s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:24 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7a8c117b-8321-42f1-a51f-238e729ff5d2" returned: 0 in 0.668s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Lock "cinder-quobyte-7a8c117b-8321-42f1-a51f-238e729ff5d2" released by "delete_volume" :: held 1.485s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Created reservations ['94c39f68-f08a-4246-a84c-208be81f6e15', '3ca8966b-b5d9-47ff-a75a-0110d9f47a30', '6088bc0b-cb86-44a1-b2de-6d3963fa1a02', 'dc9c0cf8-a3b2-4ef5-9a88-583aa24ce317'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:24 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-a11ae737-352c-423c-9684-95759887db8f" returned: 0 in 0.676s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Created reservations ['de0aca40-e681-4c0d-829e-409cc768d9d4', 'b0d610ec-5b90-434b-b2a7-a7195c1f4ddd', '376ebab9-ea98-46fd-89ad-58d613e87e40', 'a7e6a250-085a-4432-bb38-cd83af349362'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-quobyte-a11ae737-352c-423c-9684-95759887db8f" released by "delete_volume" :: held 1.499s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:24 devstack sudo[91978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:24 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:24 devstack sudo[91980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:24 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Created reservations ['2aa58354-8d49-4c9b-97ed-0d023f5f48e2', '08dbb114-81d9-4ad8-ad90-5d316b7d0d68', 'bd6cad59-fdbe-494e-bf4c-6da759d062de', 'f4f46ac4-4b02-4645-b28f-a812b3185e2f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:24 devstack sudo[91982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:24 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:25 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.715s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Deleted volume successfully.
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "cinder-660f6e7e-f135-4db7-a635-d15316f6d076-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:25 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.732s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-660f6e7e-f135-4db7-a635-d15316f6d076-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-87a89902-81ad-45c4-a549-670d89ff0480 tempest-VolumesListAdminTestJSON-717341280 None] Lock "cinder-20b03a38-8456-4993-842e-30d84a66d0bd-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Deleted volume successfully.
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6f116d64-d62a-4dd1-a408-fd3fcc8879fb tempest-CinderUnicodeTest-309830440 None] Lock "cinder-7a8c117b-8321-42f1-a51f-238e729ff5d2-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:25 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "cinder-quobyte-660f6e7e-f135-4db7-a635-d15316f6d076" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.735s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Deleted volume successfully.
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-quobyte-660f6e7e-f135-4db7-a635-d15316f6d076" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2661f31f-ac2d-47d4-a4b3-cb1827d6f78a tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-a11ae737-352c-423c-9684-95759887db8f-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d4a096-d8b1-4647-99c4-9a7218976875]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:25 devstack sudo[91987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076
Apr 29 09:16:25 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:26 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076" returned: 0 in 0.795s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:26 devstack sudo[91992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076
Apr 29 09:16:26 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:27 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-660f6e7e-f135-4db7-a635-d15316f6d076" returned: 0 in 0.611s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-quobyte-660f6e7e-f135-4db7-a635-d15316f6d076" released by "delete_volume" :: held 1.458s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Created reservations ['6b3c76a5-c3eb-4db6-8c72-d80993af7204', 'cfc41eab-1261-4cfb-9aae-6629af701b93', '059e0343-b241-423b-a7e6-4a3749fff874', 'ff061475-8ab8-4f77-80c6-fba61e4420ea'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:27 devstack sudo[91995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:27 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:27 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "cinder-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.592s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Deleted volume successfully.
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-82cbe145-e6e3-415c-ac7e-d816fe96c9dc tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-660f6e7e-f135-4db7-a635-d15316f6d076-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "cinder-quobyte-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-quobyte-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e" acquired by "delete_volume" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f9e444-11e9-413c-8d8e-3cb448307b21]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:27 devstack sudo[91998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e
Apr 29 09:16:27 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:28 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e" returned: 0 in 0.661s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:28 devstack sudo[92003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e
Apr 29 09:16:28 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:29 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e" returned: 0 in 0.556s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-quobyte-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e" released by "delete_volume" :: held 1.254s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Created reservations ['7cf91a14-5240-4a93-9d64-89f72a40e8fd', '73aeb340-c40d-4f3d-b181-c6a8b7afa2a5', '01922495-124c-4a93-ae24-b9a1b411e104', '61f43b82-074c-4fa7-a897-b99d0cc70f1b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:29 devstack sudo[92006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:29 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:29 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.556s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Deleted volume successfully.
Apr 29 09:16:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ee3b89b5-615b-46c6-a1d0-f1dbe285a9ce tempest-VolumesListAdminTestJSON-1068322316 None] Lock "cinder-cfb96e3d-b25f-4c6f-8fa3-080be4e5e61e-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Flow 'volume_create_manager' (a5782090-0500-44ff-bc8f-6a8360ab95da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1292447f-f2e9-4ffd-9e56-2aea32f14c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1292447f-f2e9-4ffd-9e56-2aea32f14c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-760214112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c9f7bb1e54438bd1ae6ceda81cdba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:33Z,use_quota=True,user_id='01a5d8da92184d4ea49102a8f1a2ce91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab42632f-bb0f-450b-8fb8-7a4c1746feea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab42632f-bb0f-450b-8fb8-7a4c1746feea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848e2aa0-4e0b-4503-b28e-e7c313ae14bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848e2aa0-4e0b-4503-b28e-e7c313ae14bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f', 'volume_name': 'volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f15c4-f706-49f1-b607-8159188eb282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b59f15c4-f706-49f1-b607-8159188eb282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978cd381-0b7b-44fa-9331-bf2afdfd297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Volume 0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f', 'volume_size': 1}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-760214112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c9f7bb1e54438bd1ae6ceda81cdba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:33Z,use_quota=True,user_id='01a5d8da92184d4ea49102a8f1a2ce91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Creating volume 0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:33 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:33 devstack sudo[92009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f 1073741824
Apr 29 09:16:33 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:34 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f 1073741824" returned: 0 in 0.737s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:34 devstack sudo[92014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f
Apr 29 09:16:34 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:34 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" returned: 0 in 0.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978cd381-0b7b-44fa-9331-bf2afdfd297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0975c00a-a7b5-49c3-84da-be0d46e00d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Volume volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f (0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f): created successfully
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0975c00a-a7b5-49c3-84da-be0d46e00d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Flow 'volume_create_manager' (a5782090-0500-44ff-bc8f-6a8360ab95da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:34 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ddcd4360-7297-4d70-a644-b6e6915e370c tempest-VolumesCloneTest-738982747 None] Created volume successfully.
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Flow 'volume_create_manager' (90c32e47-dbff-43f6-8e86-8f2b28a666c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac063f1a-4ef5-453f-9010-fb3486d00718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac063f1a-4ef5-453f-9010-fb3486d00718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1262981711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423a56c7-a0d7-4a77-bade-59753b09fe4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3c9f7bb1e54438bd1ae6ceda81cdba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:36Z,use_quota=True,user_id='01a5d8da92184d4ea49102a8f1a2ce91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65eb103-8ca2-4bef-8c74-fcef0892daba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e65eb103-8ca2-4bef-8c74-fcef0892daba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5e3bcb-8d1f-40bb-8756-630cc802c3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5e3bcb-8d1f-40bb-8756-630cc802c3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '423a56c7-a0d7-4a77-bade-59753b09fe4e', 'volume_name': 'volume-423a56c7-a0d7-4a77-bade-59753b09fe4e', 'volume_size': 2, 'source_volid': '0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f428fd1-fd20-4729-ba97-d2b1bbb7ac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f428fd1-fd20-4729-ba97-d2b1bbb7ac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1424b0b8-179c-43ee-823a-04dde0c6d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Volume 423a56c7-a0d7-4a77-bade-59753b09fe4e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-423a56c7-a0d7-4a77-bade-59753b09fe4e', 'volume_size': 2, 'source_volid': '0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f', 'source_volstatus': 'available'}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:35 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Cloning volume 0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f to volume 423a56c7-a0d7-4a77-bade-59753b09fe4e
Apr 29 09:16:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Creating offline snapshot 4d5014d5-74fa-430c-9621-a12f3718ebdf of volume 0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:16:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9d5000-17be-42a0-9ee4-b3a25c0dd1b9]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:36 devstack sudo[92019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f
Apr 29 09:16:36 devstack sudo[92019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:36 devstack sudo[92019]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:36 devstack sudo[92024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf 1G
Apr 29 09:16:36 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:37 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf 1G" returned: 0 in 0.715s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:37 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf
Apr 29 09:16:37 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:38 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:38 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf is being set with open permissions: ugo+rw
Apr 29 09:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:38 devstack sudo[92035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf
Apr 29 09:16:38 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:38 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf" returned: 0 in 0.554s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:38 devstack sudo[92039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.info
Apr 29 09:16:38 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:39 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.info" returned: 0 in 0.564s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:39 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.info is being set with open permissions: ugo+rw
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:39 devstack sudo[92042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.info
Apr 29 09:16:39 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:39 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.info" returned: 0 in 0.565s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Acquiring lock "cinder-quobyte-423a56c7-a0d7-4a77-bade-59753b09fe4e" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-423a56c7-a0d7-4a77-bade-59753b09fe4e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] snapshot: 4d5014d5-74fa-430c-9621-a12f3718ebdf, volume: 423a56c7-a0d7-4a77-bade-59753b09fe4e,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3083d48f-6b58-45af-a088-01ba74d3f97f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:39 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf
Apr 29 09:16:39 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:40 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf" returned: 0 in 0.662s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:16:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:16:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:16:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f7cdb0-fec5-47fc-9c2b-e7df56fcfdd6]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:40 devstack sudo[92050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f
Apr 29 09:16:40 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:41 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" returned: 0 in 0.670s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:41 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:16:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:41 devstack sudo[92056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e
Apr 29 09:16:41 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:45 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e" returned: 0 in 4.169s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c98e0e-e3fc-401c-8366-24fab92c78de]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:45 devstack sudo[92072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f
Apr 29 09:16:45 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:46 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" returned: 0 in 0.811s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f, size 1024.00 MB, duration 4.17 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:16:46 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Converted 1024.00 MB image at 245.54 MB/s
Apr 29 09:16:46 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e is being set with open permissions: ugo+rw
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:46 devstack sudo[92077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e
Apr 29 09:16:46 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:46 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e" returned: 0 in 0.556s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-423a56c7-a0d7-4a77-bade-59753b09fe4e" released by "_copy_volume_from_snapshot" :: held 6.940s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:DELETE=11,cinder:SELECT=116,cinder:UPDATE=177,cinder:INSERT=45 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Acquiring lock "cinder-quobyte-4d5014d5-74fa-430c-9621-a12f3718ebdf" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-4d5014d5-74fa-430c-9621-a12f3718ebdf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Deleting offline snapshot 4d5014d5-74fa-430c-9621-a12f3718ebdf of volume 0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] snapshot_file for this snap is: volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe30c1d8-f40e-4df7-8771-85f06461ec01]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:46 devstack sudo[92080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf
Apr 29 09:16:46 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:47 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf" returned: 0 in 0.663s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:16:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[10873360-9cb9-4aed-ad66-8f88e31a4c7c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:47 devstack sudo[92085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f
Apr 29 09:16:47 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:48 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:48 devstack sudo[92090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf
Apr 29 09:16:48 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:48 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:INSERT=44,cinder:UPDATE=178,cinder:SELECT=121,cinder:DELETE=21 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:16:48 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf" returned: 0 in 0.657s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:48 devstack sudo[92095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf
Apr 29 09:16:48 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:49 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f.4d5014d5-74fa-430c-9621-a12f3718ebdf" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-4d5014d5-74fa-430c-9621-a12f3718ebdf" released by "_delete_snapshot" :: held 2.683s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.466s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1424b0b8-179c-43ee-823a-04dde0c6d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423a56c7-a0d7-4a77-bade-59753b09fe4e', 'volume_size': 2, 'source_volid': '0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf196326-b692-499d-99d4-1cdf5478c50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:49 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Volume volume-423a56c7-a0d7-4a77-bade-59753b09fe4e (423a56c7-a0d7-4a77-bade-59753b09fe4e): created successfully
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf196326-b692-499d-99d4-1cdf5478c50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Flow 'volume_create_manager' (90c32e47-dbff-43f6-8e86-8f2b28a666c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-36d93cba-1bc8-42b3-a98a-6882afa6183a tempest-VolumesCloneTest-738982747 None] Created volume successfully.
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Acquiring lock "cinder-423a56c7-a0d7-4a77-bade-59753b09fe4e-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Lock "cinder-423a56c7-a0d7-4a77-bade-59753b09fe4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Acquiring lock "cinder-quobyte-423a56c7-a0d7-4a77-bade-59753b09fe4e" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-423a56c7-a0d7-4a77-bade-59753b09fe4e" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c379e76c-9ce5-4628-aba9-114318015b03]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:50 devstack sudo[92098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e
Apr 29 09:16:50 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:50 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e" returned: 0 in 0.662s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:50 devstack sudo[92103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e
Apr 29 09:16:50 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:51 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-423a56c7-a0d7-4a77-bade-59753b09fe4e" returned: 0 in 0.560s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-423a56c7-a0d7-4a77-bade-59753b09fe4e" released by "delete_volume" :: held 1.260s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Created reservations ['3dffea64-72a2-413f-ad52-d306bfe8ea01', '6e7582dd-9d25-4be9-8058-c962a088a548', '68254079-6f01-43c7-8282-ad36560e382d', 'dbca0765-6939-4e54-bdd4-cc8b99f9efb8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:51 devstack sudo[92106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:51 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:51 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.559s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:51 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Deleted volume successfully.
Apr 29 09:16:51 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-593126e8-f45a-4e0e-b7a4-bd4a1c60a433 tempest-VolumesCloneTest-738982747 None] Lock "cinder-423a56c7-a0d7-4a77-bade-59753b09fe4e-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Acquiring lock "cinder-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Lock "cinder-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Acquiring lock "cinder-quobyte-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8223e-50ae-4824-87ca-e1dab642ff9b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:52 devstack sudo[92109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f
Apr 29 09:16:52 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:52 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" returned: 0 in 0.676s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:52 devstack sudo[92114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f
Apr 29 09:16:52 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:53 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" returned: 0 in 0.559s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Lock "cinder-quobyte-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f" released by "delete_volume" :: held 1.287s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Created reservations ['637bdb62-7a49-4694-9140-8f9d8f90188f', '2bdf2154-358b-4284-8b7f-7c65357eea3d', '78ae92b5-cdd8-4722-a615-cc4bb2652aa0', 'c74a64f3-b3b8-43b5-90ec-34cc35f26f27'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:53 devstack sudo[92117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:53 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:54 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.547s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:54 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:54 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Deleted volume successfully.
Apr 29 09:16:54 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-26f74a5a-69f9-4814-89f2-2d66f7b81126 tempest-VolumesCloneTest-738982747 None] Lock "cinder-0f38f2d6-5cdd-492d-b5f8-5f80874d2c5f-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Flow 'volume_create_manager' (50d8b461-06f6-4cc8-9d20-9713d658f34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78d3580-7a2b-42a2-afd0-1b70df770fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78d3580-7a2b-42a2-afd0-1b70df770fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-571877767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a923ef-3423-403c-b91c-bc90a4cb6809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb8549925ad40108c4411fc75213947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:57Z,use_quota=True,user_id='96189656a8324648a0647296011eda95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa45619-d163-4016-b145-98b03b8134fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa45619-d163-4016-b145-98b03b8134fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32d2001-00de-42c8-aa42-e20e3a6f3398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32d2001-00de-42c8-aa42-e20e3a6f3398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a923ef-3423-403c-b91c-bc90a4cb6809', 'volume_name': 'volume-c9a923ef-3423-403c-b91c-bc90a4cb6809', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e19e3e-ba32-4e9f-b51b-106a1b39947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e19e3e-ba32-4e9f-b51b-106a1b39947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5885416-17e3-4cc6-ae6d-94053243777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Volume c9a923ef-3423-403c-b91c-bc90a4cb6809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a923ef-3423-403c-b91c-bc90a4cb6809', 'volume_size': 2}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-571877767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a923ef-3423-403c-b91c-bc90a4cb6809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbb8549925ad40108c4411fc75213947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:16:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:16:57Z,use_quota=True,user_id='96189656a8324648a0647296011eda95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Creating volume c9a923ef-3423-403c-b91c-bc90a4cb6809 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:16:56 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:16:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809 2147483648 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:56 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809 2147483648
Apr 29 09:16:56 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:57 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809 2147483648" returned: 0 in 0.797s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:57 devstack sudo[92127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809
Apr 29 09:16:57 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:58 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809" returned: 0 in 0.550s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:16:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5885416-17e3-4cc6-ae6d-94053243777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a923ef-3423-403c-b91c-bc90a4cb6809', 'volume_size': 2}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2a0e47-fd35-4af5-9c02-b8f95a4a56c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:16:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Volume volume-c9a923ef-3423-403c-b91c-bc90a4cb6809 (c9a923ef-3423-403c-b91c-bc90a4cb6809): created successfully
Apr 29 09:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2a0e47-fd35-4af5-9c02-b8f95a4a56c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:16:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Flow 'volume_create_manager' (50d8b461-06f6-4cc8-9d20-9713d658f34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:16:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bc377519-c239-4977-80bb-ef3dadeece23 tempest-VolumesCloneNegativeTest-1931929430 None] Created volume successfully.
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Acquiring lock "cinder-c9a923ef-3423-403c-b91c-bc90a4cb6809-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Lock "cinder-c9a923ef-3423-403c-b91c-bc90a4cb6809-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Acquiring lock "cinder-quobyte-c9a923ef-3423-403c-b91c-bc90a4cb6809" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Lock "cinder-quobyte-c9a923ef-3423-403c-b91c-bc90a4cb6809" acquired by "delete_volume" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc3ee0b-3e9e-4a0e-9b30-98b0d8c12044]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:59 devstack sudo[92130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:16:59 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:59 devstack sudo[92131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809
Apr 29 09:16:59 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:16:59 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:16:59 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809" returned: 0 in 0.676s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:16:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:16:59 devstack sudo[92138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809
Apr 29 09:16:59 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:00 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-c9a923ef-3423-403c-b91c-bc90a4cb6809" returned: 0 in 0.555s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Lock "cinder-quobyte-c9a923ef-3423-403c-b91c-bc90a4cb6809" released by "delete_volume" :: held 1.282s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Created reservations ['e9510029-5ab4-485d-8630-fca050e3e174', '050ffb1c-ea5d-4ad3-a652-4153d589e4ab', 'f126ebf8-5494-4e39-9764-757176d9ad4c', '7cb0f1e7-eb63-4f5e-9711-f4b3d8cf008b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:00 devstack sudo[92141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:17:00 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:01 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.551s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:01 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:17:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Deleted volume successfully.
Apr 29 09:17:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bd8d8069-1dae-466e-a3b9-3780c132ef0d tempest-VolumesCloneNegativeTest-1931929430 None] Lock "cinder-c9a923ef-3423-403c-b91c-bc90a4cb6809-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Flow 'volume_create_manager' (d2d4a16e-1925-40f1-a151-78c0209e28ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9941b9bb-d27b-4588-bb9c-bbc0790b302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9941b9bb-d27b-4588-bb9c-bbc0790b302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1486744360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e7b492-6920-4586-9595-df5e2d5d8792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e9f64a7dae4047a9fc03dab720b245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:04Z,use_quota=True,user_id='043ea32d48054c13a8c53e0ba275fd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62569ae3-fab2-43c4-9a71-3f09dc12f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62569ae3-fab2-43c4-9a71-3f09dc12f969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a5962d-2bae-488d-bf6d-51a3a577fa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:03 devstack cinder-volume[83863]: DEBUG cinder.image.glance [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Creating Keystone auth plugin from conf {{(pid=83863) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a5962d-2bae-488d-bf6d-51a3a577fa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35e7b492-6920-4586-9595-df5e2d5d8792', 'volume_name': 'volume-35e7b492-6920-4586-9595-df5e2d5d8792', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491daf4890>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3014bcfa-49ab-4438-91bc-b92089349580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3014bcfa-49ab-4438-91bc-b92089349580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abeaaee-33c0-41b2-899a-b19286041e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Volume 35e7b492-6920-4586-9595-df5e2d5d8792: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35e7b492-6920-4586-9595-df5e2d5d8792', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491daf4890>}
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Trying to clone 35e7b492-6920-4586-9595-df5e2d5d8792 from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]). {{(pid=83863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 29 09:17:04 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Image download 20.69 MB at 20.69 MB/s
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad2790c-ab59-4c1c-b5c2-8eb2e2eed7a1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:04 devstack sudo[92149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD
Apr 29 09:17:04 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:05 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f is fetched for user 043ea32d48054c13a8c53e0ba275fd7c. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfdfc18-73d1-4f0a-a203-420e9ce868a5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:05 devstack sudo[92154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD
Apr 29 09:17:05 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:05 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1486744360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e7b492-6920-4586-9595-df5e2d5d8792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e9f64a7dae4047a9fc03dab720b245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:04Z,use_quota=True,user_id='043ea32d48054c13a8c53e0ba275fd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Creating volume 35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:17:05 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:17:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:05 devstack sudo[92159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 1073741824
Apr 29 09:17:05 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:06 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 1073741824" returned: 0 in 0.711s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:06 devstack sudo[92164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:06 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:07 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 0 in 0.547s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Attempting download of c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume 35e7b492-6920-4586-9595-df5e2d5d8792. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d8813-f39e-490d-8475-2f253f0ed7d6]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_0vf23vvu {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:07 devstack sudo[92167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_0vf23vvu
Apr 29 09:17:07 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:07 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_0vf23vvu" returned: 0 in 0.628s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_0vf23vvu {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:07 devstack sudo[92171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_0vf23vvu
Apr 29 09:17:07 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:08 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_0vf23vvu" returned: 1 in 0.632s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_0vf23vvu' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:17:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dde1bc-76da-4119-a5eb-71e97516c118]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:08 devstack sudo[92175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD
Apr 29 09:17:08 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:09 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD" returned: 0 in 0.646s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:09 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f was qcow2, converting to raw {{(pid=83863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 29 09:17:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:09 devstack sudo[92180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:09 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:10 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 0 in 1.685s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:10 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f_k26vib4bdevstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:17:10 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Converted 112.00 MB image at 66.43 MB/s
Apr 29 09:17:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:10 devstack sudo[92192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 1G
Apr 29 09:17:10 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:11 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 1G" returned: 0 in 0.591s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[484965c8-b1be-47ab-83e7-ab69fdb0af4d]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:11 devstack sudo[92197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:11 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:12 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 0 in 0.646s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:12 devstack sudo[92201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:12 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:12 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 1 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Downloaded image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f ((None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}])) to volume 35e7b492-6920-4586-9595-df5e2d5d8792 successfully. {{(pid=83863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Temporary image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f for user 043ea32d48054c13a8c53e0ba275fd7c is deleted. {{(pid=83863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.volume_utils [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Marking volume 35e7b492-6920-4586-9595-df5e2d5d8792 as bootable. {{(pid=83863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Copying metadata from image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f to 35e7b492-6920-4586-9595-df5e2d5d8792. {{(pid=83863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Creating volume glance metadata for volume 35e7b492-6920-4586-9595-df5e2d5d8792 backed by image c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abeaaee-33c0-41b2-899a-b19286041e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e7b492-6920-4586-9595-df5e2d5d8792', 'volume_size': 1, 'image_id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '899c479885bb45d4b025323eb56d4857', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f', 'created_at': datetime.datetime(2026, 4, 29, 7, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 7, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0143b30-1c0a-4646-8a2a-ea2a7ee90f5f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76491daf4890>}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ceaf4e2-8def-4d06-ba8f-4245b5d60437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:12 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Volume volume-35e7b492-6920-4586-9595-df5e2d5d8792 (35e7b492-6920-4586-9595-df5e2d5d8792): created successfully
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ceaf4e2-8def-4d06-ba8f-4245b5d60437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:12 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Flow 'volume_create_manager' (d2d4a16e-1925-40f1-a151-78c0209e28ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:12 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6dd0d222-1c08-495b-8c0d-6866ce3c902a tempest-VolumesExtendTest-147376516 None] Created volume successfully.
Apr 29 09:17:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a21e7-8db5-4246-ac70-78a565691ea2]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:13 devstack sudo[92206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:13 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:14 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:14 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:14 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:14 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 1 in 0.654s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 2G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 2G" returned: 0 in 0.058s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.428s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9d94b256-5932-4fbb-be2c-bf2f8500dd95 tempest-VolumesExtendTest-147376516 None] Extend volume completed successfully.
Apr 29 09:17:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Acquiring lock "cinder-35e7b492-6920-4586-9595-df5e2d5d8792-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Lock "cinder-35e7b492-6920-4586-9595-df5e2d5d8792-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Acquiring lock "cinder-quobyte-35e7b492-6920-4586-9595-df5e2d5d8792" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-35e7b492-6920-4586-9595-df5e2d5d8792" acquired by "delete_volume" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d188046e-0b4c-4302-b62c-114eb5eeb696]: (4, 'raw') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:15 devstack sudo[92219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:15 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:16 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 0 in 0.656s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:16 devstack sudo[92223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:16 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:17 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 1 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792' failed. Not Retrying. {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:17 devstack sudo[92228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792
Apr 29 09:17:17 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:17 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-35e7b492-6920-4586-9595-df5e2d5d8792" returned: 0 in 0.554s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-35e7b492-6920-4586-9595-df5e2d5d8792" released by "delete_volume" :: held 1.918s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Created reservations ['c439e338-42c3-470d-8817-0dd68ee0bc56', '3af5b9ac-93fa-4ea6-9ceb-20bddabcd060', '92cc7769-d9f4-40b2-bdd0-164fc9b232e9', '6927f24b-962e-4c65-9d3d-e1a029a0ddf4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:17 devstack sudo[92231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:17:17 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Flow 'volume_create_manager' (eb8bb59d-7c84-4e2c-a45a-b5bcd4b3248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6187059-db08-4d49-aaf4-7b4ac292412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6187059-db08-4d49-aaf4-7b4ac292412a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1896369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b8a5a8-d306-4e15-a544-d031a075d8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e9f64a7dae4047a9fc03dab720b245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:18Z,use_quota=True,user_id='043ea32d48054c13a8c53e0ba275fd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3a2fe1-3a7c-4452-9505-91a97405b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3a2fe1-3a7c-4452-9505-91a97405b998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0839d6-a9a5-45a3-bb9c-e96f726761bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0839d6-a9a5-45a3-bb9c-e96f726761bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b8a5a8-d306-4e15-a544-d031a075d8d0', 'volume_name': 'volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01751060-6830-4908-89ed-0884e6790caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01751060-6830-4908-89ed-0884e6790caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00443ce-e357-48b4-b01f-c050eb1097b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:18 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Volume f8b8a5a8-d306-4e15-a544-d031a075d8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0', 'volume_size': 1}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1896369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8b8a5a8-d306-4e15-a544-d031a075d8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e9f64a7dae4047a9fc03dab720b245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:18Z,use_quota=True,user_id='043ea32d48054c13a8c53e0ba275fd7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Creating volume f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:18 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:17:18 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.603s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:17:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Deleted volume successfully.
Apr 29 09:17:18 devstack sudo[92234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 1073741824
Apr 29 09:17:18 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9f36554c-88d8-4903-aa20-6e31d7d61d28 tempest-VolumesExtendTest-147376516 None] Lock "cinder-35e7b492-6920-4586-9595-df5e2d5d8792-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:19 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 1073741824" returned: 0 in 0.720s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:19 devstack sudo[92240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0
Apr 29 09:17:19 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:19 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0" returned: 0 in 0.577s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00443ce-e357-48b4-b01f-c050eb1097b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6845e4-d5bd-4338-bee0-bca97bd18e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Volume volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 (f8b8a5a8-d306-4e15-a544-d031a075d8d0): created successfully
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6845e4-d5bd-4338-bee0-bca97bd18e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Flow 'volume_create_manager' (eb8bb59d-7c84-4e2c-a45a-b5bcd4b3248d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f99aed94-a335-462a-8b3d-5fcff1264ad9 tempest-VolumesExtendTest-147376516 None] Created volume successfully.
Apr 29 09:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:20 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Creating offline snapshot a8b000e1-6fe6-43c5-94c6-3d4d59078633 of volume f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:17:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e416e69-c541-4e8d-b0ae-a4efe343068c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:20 devstack sudo[92243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0
Apr 29 09:17:20 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:21 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0" returned: 0 in 0.670s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:21 devstack sudo[92248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 1G
Apr 29 09:17:21 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:22 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 1G" returned: 0 in 0.699s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:22 devstack sudo[92253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633
Apr 29 09:17:22 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:22 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633" returned: 0 in 0.596s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:22 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 is being set with open permissions: ugo+rw
Apr 29 09:17:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:22 devstack sudo[92258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633
Apr 29 09:17:22 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:23 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633" returned: 0 in 0.558s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:23 devstack sudo[92271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.info
Apr 29 09:17:23 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:23 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.info" returned: 0 in 0.572s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:23 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.info is being set with open permissions: ugo+rw
Apr 29 09:17:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:23 devstack sudo[92306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.info
Apr 29 09:17:23 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:24 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.info" returned: 0 in 0.558s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.735s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4c8c5bae-dfee-4898-b5a3-84a65c14ee82 tempest-VolumesExtendTest-147376516 None] Create snapshot completed successfully
Apr 29 09:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:24 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25491513-60ba-4ab6-99f4-654c14d4d07e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:24 devstack sudo[92310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0
Apr 29 09:17:24 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:25 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0" returned: 0 in 0.708s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 2G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 2G" returned: 0 in 0.109s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.849s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-afb47fa3-1d40-468e-a6a8-2bcd010b5f98 tempest-VolumesExtendTest-147376516 None] Extend volume completed successfully.
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Acquiring lock "cinder-a8b000e1-6fe6-43c5-94c6-3d4d59078633-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Lock "cinder-a8b000e1-6fe6-43c5-94c6-3d4d59078633-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Acquiring lock "cinder-quobyte-f8b8a5a8-d306-4e15-a544-d031a075d8d0" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-f8b8a5a8-d306-4e15-a544-d031a075d8d0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Acquiring lock "cinder-quobyte-a8b000e1-6fe6-43c5-94c6-3d4d59078633" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-a8b000e1-6fe6-43c5-94c6-3d4d59078633" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Deleting offline snapshot a8b000e1-6fe6-43c5-94c6-3d4d59078633 of volume f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] snapshot_file for this snap is: volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43b38a1-cc14-423d-9ee2-7fa6867be798]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:26 devstack sudo[92319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633
Apr 29 09:17:26 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:26 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633" returned: 0 in 0.665s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed52007b-3a1d-44cd-bfbc-aac1add48b9c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:26 devstack sudo[92324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0
Apr 29 09:17:26 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:27 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:27 devstack sudo[92329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633
Apr 29 09:17:27 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:28 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633" returned: 0 in 0.670s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:28 devstack sudo[92335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633
Apr 29 09:17:28 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:28 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0.a8b000e1-6fe6-43c5-94c6-3d4d59078633" returned: 0 in 0.571s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-a8b000e1-6fe6-43c5-94c6-3d4d59078633" released by "_delete_snapshot" :: held 2.682s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-f8b8a5a8-d306-4e15-a544-d031a075d8d0" released by "delete_snapshot" :: held 2.702s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:28 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Created reservations ['70321528-fbbf-4971-9c8c-3624b9cd27c4', '11771810-c7c3-41ff-91a1-05bab6aafc4a', '5f9ab839-3855-4c9b-86c2-d67f06597648', 'd5b2bea8-7917-447b-ac9c-d751d7bf2c02'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:17:28 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Delete snapshot completed successfully.
Apr 29 09:17:28 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ecb762de-3543-41e0-862a-6ef6179727b4 tempest-VolumesExtendTest-147376516 None] Lock "cinder-a8b000e1-6fe6-43c5-94c6-3d4d59078633-delete_snapshot" released by "delete_snapshot" :: held 2.814s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Acquiring lock "cinder-f8b8a5a8-d306-4e15-a544-d031a075d8d0-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Lock "cinder-f8b8a5a8-d306-4e15-a544-d031a075d8d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Acquiring lock "cinder-quobyte-f8b8a5a8-d306-4e15-a544-d031a075d8d0" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-f8b8a5a8-d306-4e15-a544-d031a075d8d0" acquired by "delete_volume" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b302d937-e887-4d23-911d-d9647c861a2e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:29 devstack sudo[92338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0
Apr 29 09:17:29 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:30 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0" returned: 0 in 0.660s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:30 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0
Apr 29 09:17:30 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:30 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f8b8a5a8-d306-4e15-a544-d031a075d8d0" returned: 0 in 0.570s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Lock "cinder-quobyte-f8b8a5a8-d306-4e15-a544-d031a075d8d0" released by "delete_volume" :: held 1.280s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Created reservations ['b747487b-e5ae-4e96-869c-99b38bcdae3a', '3f788b6b-687d-4b92-82e3-1fbec36093b4', '6b5db788-f1e6-4625-8487-e2f467c5bd94', '92a2d0f0-0cbd-4241-9f8f-d2490035b653'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:30 devstack sudo[92346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:17:30 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:31 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.547s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:31 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:17:31 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Deleted volume successfully.
Apr 29 09:17:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bc5ed0b3-62a9-48de-a936-e6e943c56a9e tempest-VolumesExtendTest-147376516 None] Lock "cinder-f8b8a5a8-d306-4e15-a544-d031a075d8d0-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Flow 'volume_create_manager' (bc15a79e-c6c1-4e6d-a23b-b46e503eb35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8401f7-d5cd-49fd-9829-66d945c4284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8401f7-d5cd-49fd-9829-66d945c4284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-848736756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ebe3b1-680f-4924-92d4-ef1b54043f73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6dc340d37294dff962f683f5249a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:34Z,use_quota=True,user_id='5c6f4e929e5c4868bc38c30d9bea4634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d48096c-e7f7-405a-9438-7cf1e5e97f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d48096c-e7f7-405a-9438-7cf1e5e97f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f83396b-932f-43c4-bc08-b40503791908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f83396b-932f-43c4-bc08-b40503791908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ebe3b1-680f-4924-92d4-ef1b54043f73', 'volume_name': 'volume-09ebe3b1-680f-4924-92d4-ef1b54043f73', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b348b1f8-eadc-41ee-bb74-c30c920ca01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b348b1f8-eadc-41ee-bb74-c30c920ca01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f432749-5b86-4af1-8ef2-5640bc8c2c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Volume 09ebe3b1-680f-4924-92d4-ef1b54043f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ebe3b1-680f-4924-92d4-ef1b54043f73', 'volume_size': 1}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-848736756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ebe3b1-680f-4924-92d4-ef1b54043f73,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6dc340d37294dff962f683f5249a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:34Z,use_quota=True,user_id='5c6f4e929e5c4868bc38c30d9bea4634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Creating volume 09ebe3b1-680f-4924-92d4-ef1b54043f73 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:17:33 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:17:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:34 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73 1073741824
Apr 29 09:17:34 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:34 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73 1073741824" returned: 0 in 0.741s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:34 devstack sudo[92355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73
Apr 29 09:17:34 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:35 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73" returned: 0 in 0.561s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:17:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f432749-5b86-4af1-8ef2-5640bc8c2c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ebe3b1-680f-4924-92d4-ef1b54043f73', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c0a8fd-bdef-442a-ba1b-6e0bf8c9dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Volume volume-09ebe3b1-680f-4924-92d4-ef1b54043f73 (09ebe3b1-680f-4924-92d4-ef1b54043f73): created successfully
Apr 29 09:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c0a8fd-bdef-442a-ba1b-6e0bf8c9dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Flow 'volume_create_manager' (bc15a79e-c6c1-4e6d-a23b-b46e503eb35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-618a2a41-cb40-48fc-900d-22abe221bc8a tempest-VolumesListTestJSON-1460264117 None] Created volume successfully.
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Flow 'volume_create_manager' (d4710043-3d6b-47cb-abe2-6f31e92b0140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921cc6fd-47ea-42f1-98cf-ea3b143b0848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921cc6fd-47ea-42f1-98cf-ea3b143b0848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-630310603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba029e60-5857-4826-83a9-38e4c5ad59ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6dc340d37294dff962f683f5249a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:36Z,use_quota=True,user_id='5c6f4e929e5c4868bc38c30d9bea4634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae3d397-8f32-4175-84d5-87c12700b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae3d397-8f32-4175-84d5-87c12700b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b6cd50-d778-4a2b-a183-be1014b22784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b6cd50-d778-4a2b-a183-be1014b22784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba029e60-5857-4826-83a9-38e4c5ad59ed', 'volume_name': 'volume-ba029e60-5857-4826-83a9-38e4c5ad59ed', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0553d34-ba36-41f0-824f-3500bc014acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0553d34-ba36-41f0-824f-3500bc014acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01d6996-dc6d-47ea-bd8b-26d572e04775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:36 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Volume ba029e60-5857-4826-83a9-38e4c5ad59ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba029e60-5857-4826-83a9-38e4c5ad59ed', 'volume_size': 1}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-630310603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba029e60-5857-4826-83a9-38e4c5ad59ed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6dc340d37294dff962f683f5249a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:36Z,use_quota=True,user_id='5c6f4e929e5c4868bc38c30d9bea4634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Creating volume ba029e60-5857-4826-83a9-38e4c5ad59ed {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:17:36 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:17:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:36 devstack sudo[92358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed 1073741824
Apr 29 09:17:36 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:37 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed 1073741824" returned: 0 in 0.717s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:37 devstack sudo[92363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed
Apr 29 09:17:37 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:37 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed" returned: 0 in 0.567s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01d6996-dc6d-47ea-bd8b-26d572e04775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba029e60-5857-4826-83a9-38e4c5ad59ed', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1da9a5-38af-42cc-9d51-9b8dff565d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Volume volume-ba029e60-5857-4826-83a9-38e4c5ad59ed (ba029e60-5857-4826-83a9-38e4c5ad59ed): created successfully
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1da9a5-38af-42cc-9d51-9b8dff565d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Flow 'volume_create_manager' (d4710043-3d6b-47cb-abe2-6f31e92b0140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-023a1374-3a2f-45d7-94b9-5fb6239f0158 tempest-VolumesListTestJSON-1460264117 None] Created volume successfully.
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Flow 'volume_create_manager' (8088f85a-bf57-412a-bbfb-024f86513ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31d1989-fb90-4bf7-a210-1ac9ff45fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31d1989-fb90-4bf7-a210-1ac9ff45fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-801883296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6095480e-8cf8-4778-8e9c-d1e9d45fb81a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6dc340d37294dff962f683f5249a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:39Z,use_quota=True,user_id='5c6f4e929e5c4868bc38c30d9bea4634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a63c1e6-f4d2-46d9-9f38-c25e550404e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a63c1e6-f4d2-46d9-9f38-c25e550404e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3608edf9-7dca-49fe-a9b9-17d76dce3df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3608edf9-7dca-49fe-a9b9-17d76dce3df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6095480e-8cf8-4778-8e9c-d1e9d45fb81a', 'volume_name': 'volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15450ff8-e4e4-47b7-a370-277ba555be3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15450ff8-e4e4-47b7-a370-277ba555be3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e595cf-5972-45e9-bd6b-59027713338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:38 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Volume 6095480e-8cf8-4778-8e9c-d1e9d45fb81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a', 'volume_size': 1}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-801883296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6095480e-8cf8-4778-8e9c-d1e9d45fb81a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a6dc340d37294dff962f683f5249a49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:39Z,use_quota=True,user_id='5c6f4e929e5c4868bc38c30d9bea4634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Creating volume 6095480e-8cf8-4778-8e9c-d1e9d45fb81a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:17:38 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:17:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:38 devstack sudo[92367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a 1073741824
Apr 29 09:17:38 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:39 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a 1073741824" returned: 0 in 0.735s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:39 devstack sudo[92373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a
Apr 29 09:17:39 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:40 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a" returned: 0 in 0.583s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:17:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e595cf-5972-45e9-bd6b-59027713338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8c4123-7d76-4c45-9a29-bfd67af4524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Volume volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a (6095480e-8cf8-4778-8e9c-d1e9d45fb81a): created successfully
Apr 29 09:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8c4123-7d76-4c45-9a29-bfd67af4524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Flow 'volume_create_manager' (8088f85a-bf57-412a-bbfb-024f86513ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f0cc7328-3bbe-4190-b94a-30d7e5a71146 tempest-VolumesListTestJSON-1460264117 None] Created volume successfully.
Apr 29 09:17:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "cinder-6095480e-8cf8-4778-8e9c-d1e9d45fb81a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-6095480e-8cf8-4778-8e9c-d1e9d45fb81a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "cinder-quobyte-6095480e-8cf8-4778-8e9c-d1e9d45fb81a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-quobyte-6095480e-8cf8-4778-8e9c-d1e9d45fb81a" acquired by "delete_volume" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd1dbfe-b14c-4214-b70b-8a8eafb62f23]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:42 devstack sudo[92378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a
Apr 29 09:17:42 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:43 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a" returned: 0 in 0.661s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:43 devstack sudo[92383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a
Apr 29 09:17:43 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:44 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6095480e-8cf8-4778-8e9c-d1e9d45fb81a" returned: 0 in 0.577s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-quobyte-6095480e-8cf8-4778-8e9c-d1e9d45fb81a" released by "delete_volume" :: held 1.274s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Created reservations ['7905cb02-cc13-44d9-8ae9-3a4c3398d403', '60d2a9e4-7913-4f46-9e05-6ce349789954', '21aa813d-7142-47a8-b192-b0f6ed35a1be', 'c384feae-a085-4461-bbf6-24faf1fa5d50'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:44 devstack sudo[92386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:17:44 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:44 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.563s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:17:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Deleted volume successfully.
Apr 29 09:17:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-533afcc7-c122-48ca-82c0-1d47b7974ad3 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-6095480e-8cf8-4778-8e9c-d1e9d45fb81a-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "cinder-ba029e60-5857-4826-83a9-38e4c5ad59ed-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-ba029e60-5857-4826-83a9-38e4c5ad59ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "cinder-quobyte-ba029e60-5857-4826-83a9-38e4c5ad59ed" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-quobyte-ba029e60-5857-4826-83a9-38e4c5ad59ed" acquired by "delete_volume" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3fd85a-6e92-4543-952e-f8a20deb8535]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:45 devstack sudo[92390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed
Apr 29 09:17:45 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:45 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed" returned: 0 in 0.661s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:45 devstack sudo[92395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed
Apr 29 09:17:45 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:46 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-ba029e60-5857-4826-83a9-38e4c5ad59ed" returned: 0 in 0.559s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-quobyte-ba029e60-5857-4826-83a9-38e4c5ad59ed" released by "delete_volume" :: held 1.254s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Created reservations ['536bcb6e-ac13-4d35-831c-5c050ed029d5', '764bcca4-4f78-4aee-8af8-502cc29a3fbe', 'c66d4fd9-d1df-44dd-bd7c-92103504c011', 'adb4a370-6d8b-42f5-abc2-82caa0e23f76'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:46 devstack sudo[92398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:17:46 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:46 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.552s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:17:46 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Deleted volume successfully.
Apr 29 09:17:46 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=59,cinder:INSERT=31,cinder:UPDATE=88,cinder:DELETE=6 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:17:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4c2c2e1b-385c-49c3-9da9-500033aaa596 tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-ba029e60-5857-4826-83a9-38e4c5ad59ed-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "cinder-09ebe3b1-680f-4924-92d4-ef1b54043f73-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-09ebe3b1-680f-4924-92d4-ef1b54043f73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "cinder-quobyte-09ebe3b1-680f-4924-92d4-ef1b54043f73" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:17:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-quobyte-09ebe3b1-680f-4924-92d4-ef1b54043f73" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:17:47 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6a9e3-c840-4183-b6e9-66e84de9a60d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:47 devstack sudo[92401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73
Apr 29 09:17:47 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:48 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73" returned: 0 in 0.657s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:48 devstack sudo[92406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73
Apr 29 09:17:48 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:48 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09ebe3b1-680f-4924-92d4-ef1b54043f73" returned: 0 in 0.549s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-quobyte-09ebe3b1-680f-4924-92d4-ef1b54043f73" released by "delete_volume" :: held 1.242s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Created reservations ['d386e6ec-5fc8-4c4a-9bd8-9326afa3376b', '9836d21d-4db0-4723-b70a-8d076f52eb7b', '08d4defb-f7b8-402f-b8ee-53c7a8f27670', '75388970-cefb-4455-82a2-4866a048346c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=94,cinder:SELECT=80,cinder:DELETE=9,cinder:INSERT=24 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:48 devstack sudo[92409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:17:48 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:49 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.562s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:49 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:17:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Deleted volume successfully.
Apr 29 09:17:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9b112f3d-632b-429b-abb9-953d286d5e8b tempest-VolumesListTestJSON-1460264117 None] Lock "cinder-09ebe3b1-680f-4924-92d4-ef1b54043f73-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (ed96b130-e972-4409-855d-feb68495e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b49c1f5-49f5-4818-baa3-14960dd5dcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b49c1f5-49f5-4818-baa3-14960dd5dcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130278211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229d707c-9570-493c-a147-63bc454f3571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:52Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158dfda1-41a0-4134-895a-22a0cf8436fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158dfda1-41a0-4134-895a-22a0cf8436fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d0414f-16dd-4788-a7ec-cda490f3a9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d0414f-16dd-4788-a7ec-cda490f3a9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229d707c-9570-493c-a147-63bc454f3571', 'volume_name': 'volume-229d707c-9570-493c-a147-63bc454f3571', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a60d9c-3ac4-479e-94a4-fc619d2919d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a60d9c-3ac4-479e-94a4-fc619d2919d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16aee9b-eadb-40c5-a17c-54323bd1bf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume 229d707c-9570-493c-a147-63bc454f3571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229d707c-9570-493c-a147-63bc454f3571', 'volume_size': 1}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130278211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229d707c-9570-493c-a147-63bc454f3571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:52Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Creating volume 229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:17:51 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:17:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:51 devstack sudo[92412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 1073741824
Apr 29 09:17:51 devstack sudo[92412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:52 devstack sudo[92412]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 1073741824" returned: 0 in 0.713s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:52 devstack sudo[92418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571
Apr 29 09:17:52 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:53 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571" returned: 0 in 0.562s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:17:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16aee9b-eadb-40c5-a17c-54323bd1bf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229d707c-9570-493c-a147-63bc454f3571', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e010d67-5bd2-4560-a2a3-13625e8bbf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:53 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume volume-229d707c-9570-493c-a147-63bc454f3571 (229d707c-9570-493c-a147-63bc454f3571): created successfully
Apr 29 09:17:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e010d67-5bd2-4560-a2a3-13625e8bbf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (ed96b130-e972-4409-855d-feb68495e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3adf157e-38f2-4396-860a-e38379a018d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created volume successfully.
Apr 29 09:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:54 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Creating offline snapshot e19ca63d-4085-4657-b4ef-072a18cb8ee8 of volume 229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:17:54 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5c5013-d30b-4bcc-ae56-f9798ae4ab1e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:54 devstack sudo[92421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571
Apr 29 09:17:54 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:54 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:54 devstack sudo[92427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 1G
Apr 29 09:17:54 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:55 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 1G" returned: 0 in 0.707s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-229d707c-9570-493c-a147-63bc454f3571 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:55 devstack sudo[92433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-229d707c-9570-493c-a147-63bc454f3571 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8
Apr 29 09:17:55 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:56 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-229d707c-9570-493c-a147-63bc454f3571 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8" returned: 0 in 0.594s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:56 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 is being set with open permissions: ugo+rw
Apr 29 09:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:56 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8
Apr 29 09:17:56 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:56 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8" returned: 0 in 0.566s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:56 devstack sudo[92442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.info
Apr 29 09:17:56 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:57 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.info" returned: 0 in 0.573s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:57 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.info is being set with open permissions: ugo+rw
Apr 29 09:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:57 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.info
Apr 29 09:17:57 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:57 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.info" returned: 0 in 0.575s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.760s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2d94f5a9-71f3-4aa3-88c3-738d88796aea tempest-CreateVolumesFromSnapshotTest-1863991354 None] Create snapshot completed successfully
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (803d6c9d-acff-43d2-9488-f4a810289e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46587c00-002f-497e-8e03-4e00810ef09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46587c00-002f-497e-8e03-4e00810ef09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335775074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574618d0-09b9-4838-a23d-c0812d851f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:59Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9530e92e-7805-4c41-995f-6e51052f6230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9530e92e-7805-4c41-995f-6e51052f6230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac9208d-6176-4182-bbc6-c77896e299ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac9208d-6176-4182-bbc6-c77896e299ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574618d0-09b9-4838-a23d-c0812d851f03', 'volume_name': 'volume-574618d0-09b9-4838-a23d-c0812d851f03', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6b8fad-b586-4bcb-b0f9-d412eca58c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b6b8fad-b586-4bcb-b0f9-d412eca58c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730fd862-ac16-457d-b350-8143109a4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume 574618d0-09b9-4838-a23d-c0812d851f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574618d0-09b9-4838-a23d-c0812d851f03', 'volume_size': 1}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1335775074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=574618d0-09b9-4838-a23d-c0812d851f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:59Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Creating volume 574618d0-09b9-4838-a23d-c0812d851f03 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:17:58 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:17:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:58 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03 1073741824
Apr 29 09:17:58 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (66769fb4-5753-43bd-8972-bab3adae00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b515aca9-b977-43df-ad45-2b72ab162f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b515aca9-b977-43df-ad45-2b72ab162f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001095062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b361f8b-1144-4320-a027-6a2bebbb02e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:59Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3843b7-0f20-41e6-bff3-e14e5cc936e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3843b7-0f20-41e6-bff3-e14e5cc936e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a03604-9c8b-4845-ae84-e83df96e681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a03604-9c8b-4845-ae84-e83df96e681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b361f8b-1144-4320-a027-6a2bebbb02e4', 'volume_name': 'volume-1b361f8b-1144-4320-a027-6a2bebbb02e4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791ce863-062c-4bc1-8afe-9f6229333a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791ce863-062c-4bc1-8afe-9f6229333a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845cabcc-4fd1-40e3-b331-b8249e9d7a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume 1b361f8b-1144-4320-a027-6a2bebbb02e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b361f8b-1144-4320-a027-6a2bebbb02e4', 'volume_size': 1}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:59 devstack sudo[92450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:17:59 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (2f911cbf-1613-4ec0-9e8d-80327fd6f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62067b48-f924-4c8c-a404-be16632a48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62067b48-f924-4c8c-a404-be16632a48b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1068235675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfeb5820-0542-4462-96d5-9eb1c9c1c6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:59Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824a5216-3998-42fd-bb0e-4c997830e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (824a5216-3998-42fd-bb0e-4c997830e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cfc198-5c1b-4fe7-8085-035bea0af98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cfc198-5c1b-4fe7-8085-035bea0af98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfeb5820-0542-4462-96d5-9eb1c9c1c6a9', 'volume_name': 'volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288cb1ed-4b02-4bf1-b588-580762882977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288cb1ed-4b02-4bf1-b588-580762882977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6402c1-fd29-4e69-b557-c42a0776e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume cfeb5820-0542-4462-96d5-9eb1c9c1c6a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9', 'volume_size': 1}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:59 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03 1073741824" returned: 0 in 0.924s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (e21f506a-b8d6-491f-9506-da38142d0a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18f3729-744d-472b-a96c-f232f56ed296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18f3729-744d-472b-a96c-f232f56ed296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2049163292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd4788d-4ff3-47b2-b10c-74bd4a762026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:00Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e33940c-4a6c-4c99-8f83-31617103b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e33940c-4a6c-4c99-8f83-31617103b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e743900-07c8-4abf-9c8f-75a016a6f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e743900-07c8-4abf-9c8f-75a016a6f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd4788d-4ff3-47b2-b10c-74bd4a762026', 'volume_name': 'volume-afd4788d-4ff3-47b2-b10c-74bd4a762026', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91013f4-e6ea-473d-8880-60527b989a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91013f4-e6ea-473d-8880-60527b989a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4c755c-9bdf-491b-9471-aa31f603ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:17:59 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume afd4788d-4ff3-47b2-b10c-74bd4a762026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd4788d-4ff3-47b2-b10c-74bd4a762026', 'volume_size': 1}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:17:59 devstack sudo[92456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03
Apr 29 09:17:59 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:17:59 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.739s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:17:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (cfadf58b-5887-4993-9e74-578f67f1428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495e3d90-6d94-4e88-9366-6a155bcdc8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495e3d90-6d94-4e88-9366-6a155bcdc8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864221095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09900387-d716-4052-aca6-a868237c6059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:00Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626a9d7b-4f71-40d4-bbf4-a52f64e1b37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626a9d7b-4f71-40d4-bbf4-a52f64e1b37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7aefdf-4c6a-4b91-a3e6-f4e7eb6fbaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7aefdf-4c6a-4b91-a3e6-f4e7eb6fbaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09900387-d716-4052-aca6-a868237c6059', 'volume_name': 'volume-09900387-d716-4052-aca6-a868237c6059', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa604582-9394-4d52-8622-84108de2d12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa604582-9394-4d52-8622-84108de2d12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8495bd-e7ff-4330-8439-97a6be6e50f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume 09900387-d716-4052-aca6-a868237c6059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09900387-d716-4052-aca6-a868237c6059', 'volume_size': 1}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:00 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1001095062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b361f8b-1144-4320-a027-6a2bebbb02e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:59Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Creating volume 1b361f8b-1144-4320-a027-6a2bebbb02e4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730fd862-ac16-457d-b350-8143109a4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574618d0-09b9-4838-a23d-c0812d851f03', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5570765-2179-4f6e-b6cd-f169b07cf921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:00 devstack sudo[92459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4 1073741824
Apr 29 09:18:00 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume volume-574618d0-09b9-4838-a23d-c0812d851f03 (574618d0-09b9-4838-a23d-c0812d851f03): created successfully
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5570765-2179-4f6e-b6cd-f169b07cf921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (803d6c9d-acff-43d2-9488-f4a810289e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-296b1e2a-b596-44e4-97c2-8fdd160fea08 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created volume successfully.
Apr 29 09:18:01 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4 1073741824" returned: 0 in 0.741s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:01 devstack sudo[92465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4
Apr 29 09:18:01 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:01 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4" returned: 0 in 0.571s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.289s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1068235675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfeb5820-0542-4462-96d5-9eb1c9c1c6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:17:59Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Creating volume cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:01 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:01 devstack sudo[92468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 1073741824
Apr 29 09:18:01 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845cabcc-4fd1-40e3-b331-b8249e9d7a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b361f8b-1144-4320-a027-6a2bebbb02e4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83346668-2401-4237-8341-b42e59cf5ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume volume-1b361f8b-1144-4320-a027-6a2bebbb02e4 (1b361f8b-1144-4320-a027-6a2bebbb02e4): created successfully
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83346668-2401-4237-8341-b42e59cf5ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (66769fb4-5753-43bd-8972-bab3adae00a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3f633049-c51b-4fa5-bc88-4b3483fd6cb0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created volume successfully.
Apr 29 09:18:02 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 1073741824" returned: 0 in 0.778s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:02 devstack sudo[92473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9
Apr 29 09:18:02 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:03 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9" returned: 0 in 0.592s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.369s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2049163292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd4788d-4ff3-47b2-b10c-74bd4a762026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:00Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Creating volume afd4788d-4ff3-47b2-b10c-74bd4a762026 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:03 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6402c1-fd29-4e69-b557-c42a0776e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:03 devstack sudo[92476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026 1073741824
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396db852-0af4-4d69-9891-42bbed43c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:03 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 (cfeb5820-0542-4462-96d5-9eb1c9c1c6a9): created successfully
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396db852-0af4-4d69-9891-42bbed43c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (2f911cbf-1613-4ec0-9e8d-80327fd6f092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-94789b11-579f-43cd-9b06-b3bd205b9893 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created volume successfully.
Apr 29 09:18:03 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026 1073741824" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:04 devstack sudo[92481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026
Apr 29 09:18:04 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:04 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026" returned: 0 in 0.590s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864221095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09900387-d716-4052-aca6-a868237c6059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d3cab9745a44e2090d547c0756c1230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:00Z,use_quota=True,user_id='38132c78470a467aa5607df33bd4ff41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Creating volume 09900387-d716-4052-aca6-a868237c6059 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:04 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4c755c-9bdf-491b-9471-aa31f603ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd4788d-4ff3-47b2-b10c-74bd4a762026', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86fd980-3b99-488e-9d9a-8d53c0aa23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:04 devstack sudo[92485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059 1073741824
Apr 29 09:18:04 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:04 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume volume-afd4788d-4ff3-47b2-b10c-74bd4a762026 (afd4788d-4ff3-47b2-b10c-74bd4a762026): created successfully
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86fd980-3b99-488e-9d9a-8d53c0aa23cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:04 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (e21f506a-b8d6-491f-9506-da38142d0a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:04 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-addc8c38-d720-4f70-8014-68304724a041 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created volume successfully.
Apr 29 09:18:05 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059 1073741824" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:05 devstack sudo[92490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059
Apr 29 09:18:05 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:05 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059" returned: 0 in 0.562s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8495bd-e7ff-4330-8439-97a6be6e50f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09900387-d716-4052-aca6-a868237c6059', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762322d4-548a-494a-b6de-4b5b7d6cfa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:05 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Volume volume-09900387-d716-4052-aca6-a868237c6059 (09900387-d716-4052-aca6-a868237c6059): created successfully
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762322d4-548a-494a-b6de-4b5b7d6cfa2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:05 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Flow 'volume_create_manager' (cfadf58b-5887-4993-9e74-578f67f1428d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5b04d348-ae47-40f1-bd7a-75df2be8bf99 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created volume successfully.
Apr 29 09:18:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-09900387-d716-4052-aca6-a868237c6059-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-09900387-d716-4052-aca6-a868237c6059-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-09900387-d716-4052-aca6-a868237c6059" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-09900387-d716-4052-aca6-a868237c6059" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:06 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13206001-1572-4126-89da-e5ab0d7d968a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:06 devstack sudo[92493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059
Apr 29 09:18:06 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:07 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059" returned: 0 in 0.665s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:07 devstack sudo[92498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059
Apr 29 09:18:07 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:07 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-09900387-d716-4052-aca6-a868237c6059" returned: 0 in 0.558s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-09900387-d716-4052-aca6-a868237c6059" released by "delete_volume" :: held 1.261s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created reservations ['a38f356f-44b9-4a42-b072-18b9008d879a', '967b4ecd-f747-4789-b597-7da3bbcebf3a', 'afb114b5-5998-4830-9e63-dd564d9b8aca', 'c8005bd4-9c8a-4fc1-ac30-6a90fdaa38c4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:08 devstack sudo[92501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:08 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:08 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.588s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:08 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Deleted volume successfully.
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-074e6dbf-282e-4966-980e-28fe8338e2d8 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-09900387-d716-4052-aca6-a868237c6059-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-afd4788d-4ff3-47b2-b10c-74bd4a762026-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-afd4788d-4ff3-47b2-b10c-74bd4a762026-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-afd4788d-4ff3-47b2-b10c-74bd4a762026" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-afd4788d-4ff3-47b2-b10c-74bd4a762026" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[56236535-7a4e-4883-b601-0a0f86397963]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:09 devstack sudo[92504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026
Apr 29 09:18:09 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:09 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026" returned: 0 in 0.684s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:09 devstack sudo[92509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026
Apr 29 09:18:09 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:10 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-afd4788d-4ff3-47b2-b10c-74bd4a762026" returned: 0 in 0.556s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-afd4788d-4ff3-47b2-b10c-74bd4a762026" released by "delete_volume" :: held 1.277s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created reservations ['71ad17bd-0cbe-42ca-ba35-e5a636319b9f', '5ae924e5-17e4-45ed-b0a0-35e8b5adca22', '9084b083-6cfb-43f1-9ab2-c0817d214192', '8f496b5c-1af7-4850-8908-edff9925d314'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:10 devstack sudo[92512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:10 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:10 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.606s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Deleted volume successfully.
Apr 29 09:18:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-2a7ba3b7-f87b-49fd-b7bc-d3adbbe1fcf0 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-afd4788d-4ff3-47b2-b10c-74bd4a762026-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d0b9d5-ccb4-4743-931c-fc459bf8932f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:11 devstack sudo[92515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9
Apr 29 09:18:11 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:11 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9" returned: 0 in 0.666s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:11 devstack sudo[92520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9
Apr 29 09:18:11 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:12 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9" returned: 0 in 0.571s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9" released by "delete_volume" :: held 1.275s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created reservations ['d9a02bd0-f30e-40de-b94b-7535c588255c', '994bb780-b825-483d-ada6-96042f9bc1bb', '71ecaae6-78ba-485a-85bb-698546acbd0d', 'fc7baa37-8cca-434e-8369-e0b3ed0a456c'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:12 devstack sudo[92523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:12 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:13 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Deleted volume successfully.
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e6e87309-6869-4a61-a6c2-b6ce926c22c7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-cfeb5820-0542-4462-96d5-9eb1c9c1c6a9-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-1b361f8b-1144-4320-a027-6a2bebbb02e4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-1b361f8b-1144-4320-a027-6a2bebbb02e4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-1b361f8b-1144-4320-a027-6a2bebbb02e4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-1b361f8b-1144-4320-a027-6a2bebbb02e4" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16802dc-f65e-4b49-873a-2f9f28595d2f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:13 devstack sudo[92526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4
Apr 29 09:18:13 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:13 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4" returned: 0 in 0.650s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:14 devstack sudo[92531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4
Apr 29 09:18:14 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:14 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-1b361f8b-1144-4320-a027-6a2bebbb02e4" returned: 0 in 0.562s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-1b361f8b-1144-4320-a027-6a2bebbb02e4" released by "delete_volume" :: held 1.251s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created reservations ['bebebef6-8ccc-4fe2-b2b4-585bc8b8ee54', 'fc376a60-4822-44d5-ac44-0285d4cfa821', '4da5b8f3-fab4-4b47-88e0-62742f81cca0', 'fb82bced-5c6b-448e-98f1-3eb626d1578f'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:14 devstack sudo[92535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:14 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:15 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.557s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Deleted volume successfully.
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cc8099b7-0eca-435e-8281-deaacd4347ce tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-1b361f8b-1144-4320-a027-6a2bebbb02e4-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-574618d0-09b9-4838-a23d-c0812d851f03-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-574618d0-09b9-4838-a23d-c0812d851f03-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-574618d0-09b9-4838-a23d-c0812d851f03" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-574618d0-09b9-4838-a23d-c0812d851f03" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8a22c-75d3-4e53-9dd8-c828792a049f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:15 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03
Apr 29 09:18:15 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:16 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03" returned: 0 in 0.678s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:16 devstack sudo[92543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03
Apr 29 09:18:16 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:16 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-574618d0-09b9-4838-a23d-c0812d851f03" returned: 0 in 0.560s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-574618d0-09b9-4838-a23d-c0812d851f03" released by "delete_volume" :: held 1.277s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created reservations ['79d572d3-8681-4460-8615-fe3b36b9a80a', 'ffc61248-0bf3-40cb-86fa-f62bba40c248', '85954d01-b825-4430-b8aa-148205b167f0', '2019aa7e-59e5-47ae-bd2d-5cd1523a2392'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:16 devstack sudo[92546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:16 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:17 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.558s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:17 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Deleted volume successfully.
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de9db692-897b-424b-9b81-47eed5f54936 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-574618d0-09b9-4838-a23d-c0812d851f03-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-e19ca63d-4085-4657-b4ef-072a18cb8ee8-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-e19ca63d-4085-4657-b4ef-072a18cb8ee8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-229d707c-9570-493c-a147-63bc454f3571" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-229d707c-9570-493c-a147-63bc454f3571" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-e19ca63d-4085-4657-b4ef-072a18cb8ee8" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-e19ca63d-4085-4657-b4ef-072a18cb8ee8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Deleting offline snapshot e19ca63d-4085-4657-b4ef-072a18cb8ee8 of volume 229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] snapshot_file for this snap is: volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd10bc0e-6511-4257-8eac-6c6d75395c12]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:17 devstack sudo[92549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8
Apr 29 09:18:17 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:18 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8" returned: 0 in 0.669s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-229d707c-9570-493c-a147-63bc454f3571(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:18:18 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca041476-b9c6-4d35-bd8e-11a1f0fa5216]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:18 devstack sudo[92554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571
Apr 29 09:18:18 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:19 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571" returned: 0 in 0.680s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:19 devstack sudo[92559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8
Apr 29 09:18:19 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:19 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:19 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8
Apr 29 09:18:19 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:20 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571.e19ca63d-4085-4657-b4ef-072a18cb8ee8" returned: 0 in 0.554s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-e19ca63d-4085-4657-b4ef-072a18cb8ee8" released by "_delete_snapshot" :: held 2.637s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-229d707c-9570-493c-a147-63bc454f3571" released by "delete_snapshot" :: held 2.658s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created reservations ['4a40e976-b3b3-43b3-a387-9536dfa3007a', '82ec64b3-9273-42bb-972a-1fdcfa8384ca', 'e4877609-8b5a-42b0-984e-e8925efe017b', '8c413599-97ed-4cb7-b65c-91e3c72ceda6'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:20 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Delete snapshot completed successfully.
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4536dc93-e9b8-488a-b530-6eaba654ad52 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-e19ca63d-4085-4657-b4ef-072a18cb8ee8-delete_snapshot" released by "delete_snapshot" :: held 2.775s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-229d707c-9570-493c-a147-63bc454f3571-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-229d707c-9570-493c-a147-63bc454f3571-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "cinder-quobyte-229d707c-9570-493c-a147-63bc454f3571" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-229d707c-9570-493c-a147-63bc454f3571" acquired by "delete_volume" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6eb631-b33a-47d1-9ca4-70528b676a23]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:21 devstack sudo[92567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571
Apr 29 09:18:21 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:21 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571" returned: 0 in 0.672s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:21 devstack sudo[92572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571
Apr 29 09:18:21 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:22 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-229d707c-9570-493c-a147-63bc454f3571" returned: 0 in 0.555s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-quobyte-229d707c-9570-493c-a147-63bc454f3571" released by "delete_volume" :: held 1.284s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Created reservations ['02b1b4bc-6610-4241-b57d-2631bfe05c33', '72ed292f-6e1b-4aad-9171-c2103bcf31cc', 'ec1c8925-7db3-498c-bcac-c417a92a1d19', '1b72f3c4-586a-4530-99de-1fe58e689422'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:22 devstack sudo[92575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:22 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:22 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.556s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Deleted volume successfully.
Apr 29 09:18:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4ae45720-edee-4cb0-a371-a64b70a7dfb7 tempest-CreateVolumesFromSnapshotTest-1863991354 None] Lock "cinder-229d707c-9570-493c-a147-63bc454f3571-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:32 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=73,cinder:SELECT=56,cinder:INSERT=19,cinder:DELETE=6 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:18:32 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:UPDATE=89,cinder:SELECT=53,cinder:INSERT=18,cinder:DELETE=8 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (3c5a7852-6442-40e7-88fb-5d428e920a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a905715-e496-4d9b-a9f8-fdef98c0e561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (240173dc-0e8a-4879-8858-a8391f33ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3cfd3d-ef38-4833-83a5-f030c3d607a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a905715-e496-4d9b-a9f8-fdef98c0e561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1933323391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ae7d18-4b07-4d17-9af8-53bda4943e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85275eb-eadd-4f88-96d8-e69f13cbce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85275eb-eadd-4f88-96d8-e69f13cbce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c25244-8ef8-4463-9fe5-591a7df3ef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c25244-8ef8-4463-9fe5-591a7df3ef02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ae7d18-4b07-4d17-9af8-53bda4943e8b', 'volume_name': 'volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0aa14fa-313c-4f95-bd81-36f8a5e90b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0aa14fa-313c-4f95-bd81-36f8a5e90b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550aca2a-aa7a-43df-950e-a874060d255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume 26ae7d18-4b07-4d17-9af8-53bda4943e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b', 'volume_size': 1}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1933323391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ae7d18-4b07-4d17-9af8-53bda4943e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Creating volume 26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:33 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3cfd3d-ef38-4833-83a5-f030c3d607a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-134536018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1665c4a-2ca2-4ac3-b43f-70152a91d16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8d2f9f50254008a1c6d74533bc84a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='3f325aebdec54626b5db7ffb8ccf77ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd23ead8-0a18-4a26-b626-b7713c6190af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack sudo[92664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b 1073741824
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd23ead8-0a18-4a26-b626-b7713c6190af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9510e985-8676-4264-9be3-38e1883650a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9510e985-8676-4264-9be3-38e1883650a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1665c4a-2ca2-4ac3-b43f-70152a91d16c', 'volume_name': 'volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee3adb8-5ff7-44a4-ae6e-f13d2aa6de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee3adb8-5ff7-44a4-ae6e-f13d2aa6de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a32c64-7ae9-4db6-9844-b5319da9cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:33 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Volume d1665c4a-2ca2-4ac3-b43f-70152a91d16c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c', 'volume_size': 1}
Apr 29 09:18:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (fb888082-a952-4792-83a0-3ebdf3b0a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41fb252-c9e5-45f2-ae98-23673fa1a487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41fb252-c9e5-45f2-ae98-23673fa1a487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-220622267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da278801-a78b-4be0-8c3b-d598acd52fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da278801-a78b-4be0-8c3b-d598acd52fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0486fe-812c-4995-b745-08092ef4d2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0486fe-812c-4995-b745-08092ef4d2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8', 'volume_name': 'volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d6f533-3e23-402a-832c-57f84f64ea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d6f533-3e23-402a-832c-57f84f64ea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f81624-9c03-4d72-aade-59b628090150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Volume 8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8', 'volume_size': 1}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (194bd99f-431f-4bfe-87c5-8e228f6727b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c0575d-42a9-4d60-b235-4d12f5ed0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c0575d-42a9-4d60-b235-4d12f5ed0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826500880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91472c2-a3ed-4ef2-9aca-bb842143401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91472c2-a3ed-4ef2-9aca-bb842143401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544618e9-f857-44c4-8881-62c436d673eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544618e9-f857-44c4-8881-62c436d673eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4', 'volume_name': 'volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a10c875-ee6e-4b48-82b3-e3e3222f4521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a10c875-ee6e-4b48-82b3-e3e3222f4521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01da2ec9-089e-44a7-8bac-11b3b6d71d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:34 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Volume bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4', 'volume_size': 1}
Apr 29 09:18:34 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:35 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (9ed18e0e-0edb-44e5-a3d9-a1ca547f471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b43bb0a-9842-4b89-8e1e-982a695bfa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b 1073741824" returned: 0 in 1.129s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b43bb0a-9842-4b89-8e1e-982a695bfa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315586040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a75d63f-3d31-4960-927d-5a2f765f771d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:35Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ff9c39-f7fa-4457-8ea3-86ed909011f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ff9c39-f7fa-4457-8ea3-86ed909011f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89eb85b-af30-4141-a6ca-64fe3e5a864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f89eb85b-af30-4141-a6ca-64fe3e5a864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a75d63f-3d31-4960-927d-5a2f765f771d', 'volume_name': 'volume-4a75d63f-3d31-4960-927d-5a2f765f771d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d799813d-74ad-427f-addb-ce15c84b970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d799813d-74ad-427f-addb-ce15c84b970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bac6e0a-fe03-4bd4-a21e-48f16186e02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Volume 4a75d63f-3d31-4960-927d-5a2f765f771d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a75d63f-3d31-4960-927d-5a2f765f771d', 'volume_size': 1}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:35 devstack sudo[92671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b
Apr 29 09:18:35 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (536c597b-aa96-4ee0-8aaf-f8331fdeb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b2e77c-b8b5-4e33-acfd-8823be505ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b2e77c-b8b5-4e33-acfd-8823be505ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604604154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb2d351-357e-4ed6-aa83-5c2d837eeffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:35Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e193b189-3f6e-4203-beac-a82b5107b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e193b189-3f6e-4203-beac-a82b5107b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc906174-73ea-40f7-8c33-8c68f458692c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc906174-73ea-40f7-8c33-8c68f458692c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb2d351-357e-4ed6-aa83-5c2d837eeffd', 'volume_name': 'volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f88bc-20ef-4ba0-89d4-f1401a8b0400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f88bc-20ef-4ba0-89d4-f1401a8b0400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65060e1d-3c0a-4323-8291-41cc69cf07ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Volume 2bb2d351-357e-4ed6-aa83-5c2d837eeffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd', 'volume_size': 1}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (45b25521-ccef-43ff-9ce1-596581d151ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa4606-73a7-494b-bb99-88c3a74d82e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa4606-73a7-494b-bb99-88c3a74d82e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504664169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5b66c2-9bc5-486b-8678-a41d1e16f579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:36Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a721bb-3e2a-4731-ac5b-0a1d515ff0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a721bb-3e2a-4731-ac5b-0a1d515ff0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c674dfc7-aa83-4437-835b-c9dec2ab751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c674dfc7-aa83-4437-835b-c9dec2ab751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5b66c2-9bc5-486b-8678-a41d1e16f579', 'volume_name': 'volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa748ff-78e5-4c49-9137-6bc866f9b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa748ff-78e5-4c49-9137-6bc866f9b35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc6d08e-d6c8-4768-9be1-729fe110359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Volume 3b5b66c2-9bc5-486b-8678-a41d1e16f579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579', 'volume_size': 1}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:35 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b" returned: 0 in 0.766s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-134536018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1665c4a-2ca2-4ac3-b43f-70152a91d16c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8d2f9f50254008a1c6d74533bc84a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='3f325aebdec54626b5db7ffb8ccf77ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Creating volume d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:35 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550aca2a-aa7a-43df-950e-a874060d255f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack sudo[92674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c 1073741824
Apr 29 09:18:35 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86972d96-7667-46bf-a235-36f028b6979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:35 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b (26ae7d18-4b07-4d17-9af8-53bda4943e8b): created successfully
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86972d96-7667-46bf-a235-36f028b6979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:35 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (3c5a7852-6442-40e7-88fb-5d428e920a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:35 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-1943663c-96cf-4e63-b1d8-0cbfa0472109 tempest-CreateVolumesFromSnapshotTest-223925229 None] Created volume successfully.
Apr 29 09:18:36 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c 1073741824" returned: 0 in 0.818s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:36 devstack sudo[92680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c
Apr 29 09:18:36 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:37 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" returned: 0 in 0.618s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.101s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-220622267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Creating volume 8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:37 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74a32c64-7ae9-4db6-9844-b5319da9cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30e81ce-e4a2-4994-bf89-a8aa9acb3eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:37 devstack sudo[92683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 1073741824
Apr 29 09:18:37 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Volume volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c (d1665c4a-2ca2-4ac3-b43f-70152a91d16c): created successfully
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30e81ce-e4a2-4994-bf89-a8aa9acb3eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (240173dc-0e8a-4879-8858-a8391f33ee89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0d33da8e-1993-4d7c-bea7-5f29b6f1694e tempest-VolumeDependencyTests-333341022 None] Created volume successfully.
Apr 29 09:18:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:38 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 1073741824" returned: 0 in 1.004s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:38 devstack sudo[92690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8
Apr 29 09:18:38 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:39 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.297s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826500880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:34Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Creating volume bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:39 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:39 devstack sudo[92693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 1073741824
Apr 29 09:18:39 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f81624-9c03-4d72-aade-59b628090150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343ebff-b649-43ff-b017-4ca800088967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Volume volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 (8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8): created successfully
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5343ebff-b649-43ff-b017-4ca800088967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (fb888082-a952-4792-83a0-3ebdf3b0a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0b8f2cc0-10cd-4905-9ca4-9d12320ee542 tempest-CreateVolumesFromImageTest-1526566756 None] Created volume successfully.
Apr 29 09:18:39 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 1073741824" returned: 0 in 0.880s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:39 devstack sudo[92699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4
Apr 29 09:18:39 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:40 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4" returned: 0 in 0.629s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.503s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315586040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a75d63f-3d31-4960-927d-5a2f765f771d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:35Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Creating volume 4a75d63f-3d31-4960-927d-5a2f765f771d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:40 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:40 devstack sudo[92702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d 1073741824
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01da2ec9-089e-44a7-8bac-11b3b6d71d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:40 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a0ea91-d167-4a74-adc7-2e37f9e91f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Volume volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 (bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4): created successfully
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a0ea91-d167-4a74-adc7-2e37f9e91f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (194bd99f-431f-4bfe-87c5-8e228f6727b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:40 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4f0ad62e-aa24-4815-a154-e0c5c085be0d tempest-CreateVolumesFromImageTest-1526566756 None] Created volume successfully.
Apr 29 09:18:41 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d 1073741824" returned: 0 in 0.860s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:41 devstack sudo[92710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d
Apr 29 09:18:41 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:42 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d" returned: 0 in 0.576s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.589s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-604604154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb2d351-357e-4ed6-aa83-5c2d837eeffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:35Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Creating volume 2bb2d351-357e-4ed6-aa83-5c2d837eeffd {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:42 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:42 devstack sudo[92713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd 1073741824
Apr 29 09:18:42 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bac6e0a-fe03-4bd4-a21e-48f16186e02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a75d63f-3d31-4960-927d-5a2f765f771d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2684a1c-d759-413f-b961-054cfd84fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:42 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Volume volume-4a75d63f-3d31-4960-927d-5a2f765f771d (4a75d63f-3d31-4960-927d-5a2f765f771d): created successfully
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2684a1c-d759-413f-b961-054cfd84fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (9ed18e0e-0edb-44e5-a3d9-a1ca547f471a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:42 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-52e0d5aa-11f0-45de-b34a-077ff8aac182 tempest-CreateVolumesFromImageTest-1526566756 None] Created volume successfully.
Apr 29 09:18:42 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd 1073741824" returned: 0 in 0.852s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:42 devstack sudo[92719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd
Apr 29 09:18:42 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:43 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd" returned: 0 in 0.587s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.704s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504664169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5b66c2-9bc5-486b-8678-a41d1e16f579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c02778cad4064fc48a205eabb21e4761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:36Z,use_quota=True,user_id='fbe8b7abc0634448bf68d9e706f1c184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Creating volume 3b5b66c2-9bc5-486b-8678-a41d1e16f579 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:43 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65060e1d-3c0a-4323-8291-41cc69cf07ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:43 devstack sudo[92722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579 1073741824
Apr 29 09:18:43 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df2d002-f0a5-4c74-bc27-a2cabc87153e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:43 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Volume volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd (2bb2d351-357e-4ed6-aa83-5c2d837eeffd): created successfully
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df2d002-f0a5-4c74-bc27-a2cabc87153e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:43 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (536c597b-aa96-4ee0-8aaf-f8331fdeb64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b881beee-63a9-4eeb-b23a-6a5bbddf724d tempest-CreateVolumesFromImageTest-1526566756 None] Created volume successfully.
Apr 29 09:18:44 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579 1073741824" returned: 0 in 0.885s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:44 devstack sudo[92729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579
Apr 29 09:18:44 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:45 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc6d08e-d6c8-4768-9be1-729fe110359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d4ee0e-3bfd-4003-a7cb-5eebaba9c163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Creating offline snapshot 157958ab-570f-4290-8b08-cf406aada7ae of volume 26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:18:45 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Volume volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579 (3b5b66c2-9bc5-486b-8678-a41d1e16f579): created successfully
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d4ee0e-3bfd-4003-a7cb-5eebaba9c163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Flow 'volume_create_manager' (45b25521-ccef-43ff-9ce1-596581d151ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[74754efb-a288-4e52-ab4b-9d03d934c4cf]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:45 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-72453452-4a64-461b-bfce-e429205a1d03 tempest-CreateVolumesFromImageTest-1526566756 None] Created volume successfully.
Apr 29 09:18:45 devstack sudo[92732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b
Apr 29 09:18:45 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-3b5b66c2-9bc5-486b-8678-a41d1e16f579-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-3b5b66c2-9bc5-486b-8678-a41d1e16f579-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-quobyte-3b5b66c2-9bc5-486b-8678-a41d1e16f579" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-3b5b66c2-9bc5-486b-8678-a41d1e16f579" acquired by "delete_volume" :: waited 0.021s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8da6ff-757f-4cf1-8406-5b456ba33d1c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:45 devstack sudo[92736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579
Apr 29 09:18:45 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:46 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b" returned: 0 in 0.797s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:46 devstack sudo[92739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae 1G
Apr 29 09:18:46 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:46 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:46 devstack sudo[92748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579
Apr 29 09:18:46 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:46 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae 1G" returned: 0 in 0.871s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:46 devstack sudo[92751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae
Apr 29 09:18:46 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:47 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-3b5b66c2-9bc5-486b-8678-a41d1e16f579" returned: 0 in 0.680s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-3b5b66c2-9bc5-486b-8678-a41d1e16f579" released by "delete_volume" :: held 1.524s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Created reservations ['74429a98-57c8-42ce-9487-467aff1f0f21', 'e0c30e18-7287-491b-936c-90ab8153e90c', 'e9b596a5-afec-426c-a802-986db326578a', '88973928-34da-42a4-966a-bd9ad20e3a3e'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:47 devstack sudo[92757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:47 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:47 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae" returned: 0 in 0.697s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:47 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae is being set with open permissions: ugo+rw
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:47 devstack sudo[92759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae
Apr 29 09:18:47 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-2bb2d351-357e-4ed6-aa83-5c2d837eeffd-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-2bb2d351-357e-4ed6-aa83-5c2d837eeffd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-quobyte-2bb2d351-357e-4ed6-aa83-5c2d837eeffd" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-2bb2d351-357e-4ed6-aa83-5c2d837eeffd" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6670fc-de16-47ef-bec0-396765046293]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:48 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:48 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Deleted volume successfully.
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-97b940ff-f83d-40ae-ba37-707a39ee9c67 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-3b5b66c2-9bc5-486b-8678-a41d1e16f579-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:48 devstack sudo[92762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd
Apr 29 09:18:48 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:48 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae" returned: 0 in 0.718s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:48 devstack sudo[92765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.info
Apr 29 09:18:48 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:48 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd" returned: 0 in 0.745s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:48 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd
Apr 29 09:18:48 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:48 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.info" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:48 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.info is being set with open permissions: ugo+rw
Apr 29 09:18:48 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:49 devstack sudo[92773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.info
Apr 29 09:18:49 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:49 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2bb2d351-357e-4ed6-aa83-5c2d837eeffd" returned: 0 in 0.659s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-2bb2d351-357e-4ed6-aa83-5c2d837eeffd" released by "delete_volume" :: held 1.461s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:49 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.info" returned: 0 in 0.609s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.481s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.322s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Creating offline snapshot 3387faca-8f29-4ede-bbb6-431b38be445e of volume d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Created reservations ['51dba3e1-65cf-4f18-a9e0-b8ade74843f7', '3339155b-0d1c-4957-8546-6db19d44f0bb', '487f3ec6-9923-4df5-add7-e8e1e53f9416', 'b335a774-80b9-4848-8a8d-ce465c242fdc'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027cd64-a8b1-49ef-a65e-e588b093bcb0]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:49 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cceb799c-84dd-4169-805c-210238cb0cd7 tempest-CreateVolumesFromSnapshotTest-223925229 None] Create snapshot completed successfully
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:49 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:49 devstack sudo[92778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:49 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:49 devstack sudo[92777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c
Apr 29 09:18:49 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-4a75d63f-3d31-4960-927d-5a2f765f771d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-4a75d63f-3d31-4960-927d-5a2f765f771d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-quobyte-4a75d63f-3d31-4960-927d-5a2f765f771d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-4a75d63f-3d31-4960-927d-5a2f765f771d" acquired by "delete_volume" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8cc26d-f804-4f7a-a76f-e14bbfd1869f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:50 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" returned: 0 in 0.932s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:50 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.887s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:50 devstack sudo[92786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e 1G
Apr 29 09:18:50 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:50 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Deleted volume successfully.
Apr 29 09:18:50 devstack sudo[92785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d
Apr 29 09:18:50 devstack sudo[92785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:50 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c37aa9cc-26d4-4c60-b920-b0d242bdcb47 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-2bb2d351-357e-4ed6-aa83-5c2d837eeffd-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (626b676d-3275-4e85-8765-1c161bff6ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af09ca4b-c910-4d76-b6d0-263c9b16d3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af09ca4b-c910-4d76-b6d0-263c9b16d3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934156821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe23b0b-47b6-42b8-8a66-7f0fae830c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:51Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe40121-282f-47c7-bb15-4af33c7797f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe40121-282f-47c7-bb15-4af33c7797f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efa8bf4-8841-4acd-9527-978f9c8eb946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efa8bf4-8841-4acd-9527-978f9c8eb946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe23b0b-47b6-42b8-8a66-7f0fae830c31', 'volume_name': 'volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ecb6bc-616a-4ca7-be0f-4d64dfbcc2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ecb6bc-616a-4ca7-be0f-4d64dfbcc2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0438f2c-aa92-4908-9837-aab2b400df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:51 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume 2fe23b0b-47b6-42b8-8a66-7f0fae830c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31', 'volume_size': 1}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:51 devstack sudo[92785]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d" returned: 0 in 1.087s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:51 devstack sudo[92796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d
Apr 29 09:18:51 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:51 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (4b23e1b6-3df7-4c64-88c9-8b236a0a7efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9db3c0b-6e34-42af-8bf4-d8a29a2fa721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e 1G" returned: 0 in 1.357s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:52 devstack sudo[92798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e
Apr 29 09:18:52 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9db3c0b-6e34-42af-8bf4-d8a29a2fa721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481569704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b755875-8781-4140-acba-aed48a6c925b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:52Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bdd0e0-cc8e-45c7-9333-fb1a511a30e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bdd0e0-cc8e-45c7-9333-fb1a511a30e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de29e5f-a1b2-411f-914e-5cec23cccb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de29e5f-a1b2-411f-914e-5cec23cccb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b755875-8781-4140-acba-aed48a6c925b', 'volume_name': 'volume-6b755875-8781-4140-acba-aed48a6c925b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed355ed-8da0-4f64-a595-932668f3bab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed355ed-8da0-4f64-a595-932668f3bab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a7d964-fa15-4b82-bc2f-41068e6c3bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume 6b755875-8781-4140-acba-aed48a6c925b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b755875-8781-4140-acba-aed48a6c925b', 'volume_size': 1}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (3844dd52-b696-46ec-a348-e443981e7c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfbe57d-fff8-406b-9d1f-d6b3cab059c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfbe57d-fff8-406b-9d1f-d6b3cab059c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439374408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f05dad2-f375-4c89-ac13-eebffdbe9cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:52Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1a4c4b-5d61-4553-83d8-49aaf63694f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1a4c4b-5d61-4553-83d8-49aaf63694f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180cbf6c-47cd-4e6a-8d9a-5db3e9a0f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180cbf6c-47cd-4e6a-8d9a-5db3e9a0f352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f05dad2-f375-4c89-ac13-eebffdbe9cbc', 'volume_name': 'volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f64eb8-f436-4021-bfc9-665ae6188d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f64eb8-f436-4021-bfc9-665ae6188d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160d9d99-d540-48e4-8616-b68031b9419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume 9f05dad2-f375-4c89-ac13-eebffdbe9cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc', 'volume_size': 1}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:52 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4a75d63f-3d31-4960-927d-5a2f765f771d" returned: 0 in 0.980s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-4a75d63f-3d31-4960-927d-5a2f765f771d" released by "delete_volume" :: held 2.129s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (94f0419d-3254-481f-994f-681d628815d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e96ce-d9c4-4781-becf-36d5034af62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e96ce-d9c4-4781-becf-36d5034af62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146358552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f29113f-0fbb-4d65-9cf0-b6c4856efcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:53Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaf3b32-467c-442f-a865-a00775a08f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aaf3b32-467c-442f-a865-a00775a08f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6beb61d-36ea-4da9-9ba9-f39c2c1a060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6beb61d-36ea-4da9-9ba9-f39c2c1a060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f29113f-0fbb-4d65-9cf0-b6c4856efcb4', 'volume_name': 'volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cee149-1d7b-4662-ba51-062d5f0e1387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44cee149-1d7b-4662-ba51-062d5f0e1387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5515ca7-754b-4316-b0eb-20ef5e222dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:52 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume 6f29113f-0fbb-4d65-9cf0-b6c4856efcb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4', 'volume_size': 1}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Created reservations ['bcb8918d-e4c6-4692-accf-82e352cde750', 'c68fb388-891a-4686-b7b5-60e0a53d7c58', '10a1c407-b653-48f3-99a8-0302a29f41e9', 'a7a27a43-8806-44e1-aa06-5749d4122cd8'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:52 devstack sudo[92804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:52 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:52 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e" returned: 0 in 0.998s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:52 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e is being set with open permissions: ugo+rw
Apr 29 09:18:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:53 devstack sudo[92806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e
Apr 29 09:18:53 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (c2cad478-b16d-4ce6-a1e4-b98439467daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49378b35-4926-4370-aac4-746bf47033e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49378b35-4926-4370-aac4-746bf47033e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-488199515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254ab49e-ba38-43b5-bc44-4249956e53ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:53Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa14d01a-b902-49b4-a1b6-370ff2d928d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa14d01a-b902-49b4-a1b6-370ff2d928d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc7e11c-e594-4677-8c51-a6e8df6719ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc7e11c-e594-4677-8c51-a6e8df6719ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254ab49e-ba38-43b5-bc44-4249956e53ed', 'volume_name': 'volume-254ab49e-ba38-43b5-bc44-4249956e53ed', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d3eec9-a2fc-490e-b9ac-7ce69d7cf0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d3eec9-a2fc-490e-b9ac-7ce69d7cf0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5be81e-4f32-454b-a502-eeb4bef7ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:53 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume 254ab49e-ba38-43b5-bc44-4249956e53ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254ab49e-ba38-43b5-bc44-4249956e53ed', 'volume_size': 1}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:53 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.787s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:53 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Deleted volume successfully.
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-f8cf028b-d5f9-4d5a-be8d-3e963fd10a46 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-4a75d63f-3d31-4960-927d-5a2f765f771d-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:53 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e" returned: 0 in 0.811s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:53 devstack sudo[92810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.info
Apr 29 09:18:53 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-quobyte-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[740acece-cfd9-4c05-a3f7-2ad6577dce1f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:54 devstack sudo[92812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4
Apr 29 09:18:54 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:54 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.info" returned: 0 in 0.695s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:54 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.info is being set with open permissions: ugo+rw
Apr 29 09:18:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:54 devstack sudo[92816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.info
Apr 29 09:18:54 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:54 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4" returned: 0 in 0.767s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:54 devstack sudo[92821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4
Apr 29 09:18:54 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:55 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.info" returned: 0 in 0.648s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.587s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.774s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1934156821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe23b0b-47b6-42b8-8a66-7f0fae830c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:51Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Creating volume 2fe23b0b-47b6-42b8-8a66-7f0fae830c31 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:55 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-baba1ac6-b814-4b76-a7e2-bc651faba5f4 tempest-VolumeDependencyTests-333341022 None] Create snapshot completed successfully
Apr 29 09:18:55 devstack sudo[92825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31 1073741824
Apr 29 09:18:55 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:55 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4" returned: 0 in 0.605s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4" released by "delete_volume" :: held 1.435s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Created reservations ['fc07eb45-aab3-4da8-959b-f8fcbed66794', '6f3251ff-274a-4c01-bde4-0c89fe12498f', 'cba7ce2e-bc30-4215-b36c-475b08a7bc0c', '47d31051-00a9-4884-8019-a162349026fc'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:55 devstack sudo[92827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:55 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:56 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.610s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:56 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Deleted volume successfully.
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-dc83937c-82bc-46e5-bdf4-4c8500a874be tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-bc658168-0e35-43e2-b7f1-3ef4c1c1d4e4-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "cinder-quobyte-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:18:56 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ee4eb-8b75-481d-a44c-d976d9630a9f]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31 1073741824" returned: 0 in 1.048s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:56 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31
Apr 29 09:18:56 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:56 devstack sudo[92834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8
Apr 29 09:18:56 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (72044635-fb3e-4cc9-981c-022eaf407a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f0943d-1b66-4490-ab0f-f5d2da52a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f0943d-1b66-4490-ab0f-f5d2da52a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-329859393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e68fe0-e009-4f54-9d3f-06b932992506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8d2f9f50254008a1c6d74533bc84a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3387faca-8f29-4ede-bbb6-431b38be445e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:57Z,use_quota=True,user_id='3f325aebdec54626b5db7ffb8ccf77ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b371c196-c1a1-42e9-aae9-40fe76db8ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b371c196-c1a1-42e9-aae9-40fe76db8ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccee8caf-6a90-46e7-902a-90a4c68a2602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccee8caf-6a90-46e7-902a-90a4c68a2602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18e68fe0-e009-4f54-9d3f-06b932992506', 'volume_name': 'volume-18e68fe0-e009-4f54-9d3f-06b932992506', 'volume_size': 1, 'snapshot_id': '3387faca-8f29-4ede-bbb6-431b38be445e'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f38502c-2f2e-48ba-8a50-7c5e988959eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f38502c-2f2e-48ba-8a50-7c5e988959eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28efd4ce-2f5a-450a-b2e6-e50b2e0b20ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:56 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Volume 18e68fe0-e009-4f54-9d3f-06b932992506: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18e68fe0-e009-4f54-9d3f-06b932992506', 'volume_size': 1, 'snapshot_id': '3387faca-8f29-4ede-bbb6-431b38be445e'}
Apr 29 09:18:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:57 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31" returned: 0 in 0.807s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.072s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481569704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b755875-8781-4140-acba-aed48a6c925b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:52Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Creating volume 6b755875-8781-4140-acba-aed48a6c925b {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:57 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0438f2c-aa92-4908-9837-aab2b400df81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:57 devstack sudo[92842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b 1073741824
Apr 29 09:18:57 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4e1114-8523-463f-a415-f1712dd37164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31 (2fe23b0b-47b6-42b8-8a66-7f0fae830c31): created successfully
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4e1114-8523-463f-a415-f1712dd37164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (626b676d-3275-4e85-8765-1c161bff6ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-733d98c6-f923-4b4b-84c3-f322dcd3ac7e tempest-CreateVolumesFromSnapshotTest-223925229 None] Created volume successfully.
Apr 29 09:18:57 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8" returned: 0 in 1.013s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:57 devstack sudo[92844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8
Apr 29 09:18:57 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:18:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Flow 'volume_create_manager' (8a14e098-0d8c-4db1-a21b-24000bf20c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4214194-6c2d-49fc-9233-6644747dda57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:58 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4214194-6c2d-49fc-9233-6644747dda57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-461690728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a31ac1-7e37-4d77-9046-3e5b67cecdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc489001c3914111b095aa90632f5857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:58Z,use_quota=True,user_id='bdba3a4bf3e3443e900ed942682c9c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82739e44-984f-4ac7-8b0e-bdcd9e10502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82739e44-984f-4ac7-8b0e-bdcd9e10502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266fb2c-0236-4089-a168-80cbafc10463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266fb2c-0236-4089-a168-80cbafc10463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a31ac1-7e37-4d77-9046-3e5b67cecdfc', 'volume_name': 'volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:58 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61971d7d-fa01-4f62-afa6-bbfc6ab6600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61971d7d-fa01-4f62-afa6-bbfc6ab6600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfac847b-27b2-4fc2-8aa6-a069e2ae51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Volume f1a31ac1-7e37-4d77-9046-3e5b67cecdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc', 'volume_size': 1}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b 1073741824" returned: 0 in 0.876s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8" returned: 0 in 0.781s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-quobyte-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8" released by "delete_volume" :: held 1.855s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:58 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b
Apr 29 09:18:58 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Created reservations ['61153fb1-1975-40b8-80f4-3c5d6936d072', '5f95aa78-7b2e-4968-8f3f-7d12d888a0ca', '6c458af2-0786-499e-81e2-39b12baf1d10', '3edaa9b7-b312-41bc-bf57-860a2138d4de'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:58 devstack sudo[92853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:58 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:58 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b" returned: 0 in 0.634s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.440s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-439374408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f05dad2-f375-4c89-ac13-eebffdbe9cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:52Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Creating volume 9f05dad2-f375-4c89-ac13-eebffdbe9cbc {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:18:58 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:58 devstack sudo[92857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc 1073741824
Apr 29 09:18:58 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a7d964-fa15-4b82-bc2f-41068e6c3bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b755875-8781-4140-acba-aed48a6c925b', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cad3d2-106c-49a0-a7ce-ced16ff991a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:18:58 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume volume-6b755875-8781-4140-acba-aed48a6c925b (6b755875-8781-4140-acba-aed48a6c925b): created successfully
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cad3d2-106c-49a0-a7ce-ced16ff991a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (4b23e1b6-3df7-4c64-88c9-8b236a0a7efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:18:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9db2f012-2440-446b-950d-dcbf8be47c8f tempest-CreateVolumesFromSnapshotTest-223925229 None] Created volume successfully.
Apr 29 09:18:58 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.683s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:18:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Deleted volume successfully.
Apr 29 09:18:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-8140855d-48db-4978-9fd0-2b63bccd12a8 tempest-CreateVolumesFromImageTest-1526566756 None] Lock "cinder-8886fdf2-0d8f-4756-ad0b-0aca63e8d5d8-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:59 devstack sudo[92859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:18:59 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:59 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc 1073741824" returned: 0 in 0.831s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:18:59 devstack sudo[92865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc
Apr 29 09:18:59 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:18:59 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.710s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:18:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:00 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc" returned: 0 in 0.636s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.501s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146358552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f29113f-0fbb-4d65-9cf0-b6c4856efcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:53Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Creating volume 6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:00 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160d9d99-d540-48e4-8616-b68031b9419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30bbad1-05fa-4729-8ff3-ec5bbe2c92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:00 devstack sudo[92869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 1073741824
Apr 29 09:19:00 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:00 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc (9f05dad2-f375-4c89-ac13-eebffdbe9cbc): created successfully
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30bbad1-05fa-4729-8ff3-ec5bbe2c92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:00 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (3844dd52-b696-46ec-a348-e443981e7c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:00 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a875f2ee-835f-4b7a-8462-986f5d65839f tempest-CreateVolumesFromSnapshotTest-223925229 None] Created volume successfully.
Apr 29 09:19:01 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 1073741824" returned: 0 in 0.808s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:01 devstack sudo[92875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4
Apr 29 09:19:01 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (e8175960-e0ea-4be3-b54c-03fc0805cf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d110aae8-8dd7-4fbf-9ab4-f92ff40fc949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d110aae8-8dd7-4fbf-9ab4-f92ff40fc949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-782317053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509da2d0-355a-41d2-8226-ffa0a10fc90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:01Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b3596a-357a-48c6-abce-af2c1afbe13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b3596a-357a-48c6-abce-af2c1afbe13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb197dd-a886-4424-ac38-13fb5b07812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb197dd-a886-4424-ac38-13fb5b07812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509da2d0-355a-41d2-8226-ffa0a10fc90d', 'volume_name': 'volume-509da2d0-355a-41d2-8226-ffa0a10fc90d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df13fae7-e53b-422f-857b-f3540fc44fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df13fae7-e53b-422f-857b-f3540fc44fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baff9f9-a433-4f06-949b-27c34866d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume 509da2d0-355a-41d2-8226-ffa0a10fc90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509da2d0-355a-41d2-8226-ffa0a10fc90d', 'volume_size': 1}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:01 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4" returned: 0 in 0.593s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.440s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-488199515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254ab49e-ba38-43b5-bc44-4249956e53ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f398370046e4c339cde253f305b79d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:53Z,use_quota=True,user_id='27a6c594d93044499727b6c2c00b1394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Creating volume 254ab49e-ba38-43b5-bc44-4249956e53ed {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:01 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:01 devstack sudo[92878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed 1073741824
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5515ca7-754b-4316-b0eb-20ef5e222dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:01 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5d63b6-7369-4077-ae03-9b6116abbffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:01 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 (6f29113f-0fbb-4d65-9cf0-b6c4856efcb4): created successfully
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5d63b6-7369-4077-ae03-9b6116abbffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:01 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (94f0419d-3254-481f-994f-681d628815d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a5110c70-c566-47d9-9a1f-a5b373050d47 tempest-CreateVolumesFromSnapshotTest-223925229 None] Created volume successfully.
Apr 29 09:19:02 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed 1073741824" returned: 0 in 0.803s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:02 devstack sudo[92884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed
Apr 29 09:19:02 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:03 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed" returned: 0 in 0.591s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.225s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-3387faca-8f29-4ede-bbb6-431b38be445e-18e68fe0-e009-4f54-9d3f-06b932992506" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5be81e-4f32-454b-a502-eeb4bef7ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254ab49e-ba38-43b5-bc44-4249956e53ed', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e7fd8e-cc20-4767-9327-5b0cc65ca019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-3387faca-8f29-4ede-bbb6-431b38be445e-18e68fe0-e009-4f54-9d3f-06b932992506" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Creating volume 18e68fe0-e009-4f54-9d3f-06b932992506 from snapshot 3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-18e68fe0-e009-4f54-9d3f-06b932992506" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:03 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Volume volume-254ab49e-ba38-43b5-bc44-4249956e53ed (254ab49e-ba38-43b5-bc44-4249956e53ed): created successfully
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e7fd8e-cc20-4767-9327-5b0cc65ca019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Flow 'volume_create_manager' (c2cad478-b16d-4ce6-a1e4-b98439467daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-18e68fe0-e009-4f54-9d3f-06b932992506" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] snapshot: 3387faca-8f29-4ede-bbb6-431b38be445e, volume: 18e68fe0-e009-4f54-9d3f-06b932992506,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:19:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-235233de-008f-4ea1-bca4-e6c8d57f86ae tempest-CreateVolumesFromSnapshotTest-223925229 None] Created volume successfully.
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[40522dd8-dee0-4e21-a46e-53e30dddea53]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:03 devstack sudo[92887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e
Apr 29 09:19:03 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:03 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e" returned: 0 in 0.681s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2efeb8-3dd1-451a-b4e5-dcd860346f6d]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:04 devstack sudo[92893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c
Apr 29 09:19:04 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-254ab49e-ba38-43b5-bc44-4249956e53ed-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-254ab49e-ba38-43b5-bc44-4249956e53ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-254ab49e-ba38-43b5-bc44-4249956e53ed" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-254ab49e-ba38-43b5-bc44-4249956e53ed" acquired by "delete_volume" :: waited 0.023s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3b233a-1f58-4ed9-9ce1-a01974098ffb]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:04 devstack sudo[92895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed
Apr 29 09:19:04 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:04 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" returned: 0 in 0.711s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:19:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:04 devstack sudo[92901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506
Apr 29 09:19:04 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:05 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed" returned: 0 in 0.713s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:05 devstack sudo[92906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed
Apr 29 09:19:05 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:05 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-254ab49e-ba38-43b5-bc44-4249956e53ed" returned: 0 in 0.985s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-254ab49e-ba38-43b5-bc44-4249956e53ed" released by "delete_volume" :: held 1.760s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Created reservations ['ffd9b311-b9c1-4b75-a917-dd80c791477b', '49e9c443-6b3d-494c-9a8b-dc78a280412f', 'd4a6c51f-4d5f-45cb-8f2e-32785661372a', '463af34a-4d04-4a54-89c4-6c9753d58050'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:06 devstack sudo[92919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:06 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7cc121-cb2b-4505-b6d4-871275255ce4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:07 devstack sudo[92921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4
Apr 29 09:19:07 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:07 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.341s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Deleted volume successfully.
Apr 29 09:19:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-007ea7dc-f71b-4905-ae3e-492927cdbd83 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-254ab49e-ba38-43b5-bc44-4249956e53ed-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:08 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4" returned: 0 in 1.492s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:08 devstack sudo[92928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4
Apr 29 09:19:08 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:10 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4" returned: 0 in 1.727s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4" released by "delete_volume" :: held 3.299s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Created reservations ['09584b95-35e3-42e4-b675-cba91679bf70', '48cac430-355d-42ae-884f-91e60845c228', 'f683c610-f6b8-460f-9795-50f3a43b0650', 'b101574a-ac96-4160-8642-ffc5bfab6bee'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:10 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506" returned: 0 in 5.474s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8ebf8-5f1d-4a0d-a1d1-0b41e3626851]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:10 devstack sudo[92932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:10 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:10 devstack sudo[92931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c
Apr 29 09:19:10 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:10 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.609s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:10 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Deleted volume successfully.
Apr 29 09:19:10 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d0ddd793-45dc-483f-a946-45924418c25e tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-6f29113f-0fbb-4d65-9cf0-b6c4856efcb4-delete_volume" released by "delete_volume" :: held 4.196s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:11 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" returned: 0 in 0.858s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:19:11 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Converted 1024.00 MB image at 187.03 MB/s
Apr 29 09:19:11 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506 is being set with open permissions: ugo+rw
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:11 devstack sudo[92939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506
Apr 29 09:19:11 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-9f05dad2-f375-4c89-ac13-eebffdbe9cbc-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-9f05dad2-f375-4c89-ac13-eebffdbe9cbc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-9f05dad2-f375-4c89-ac13-eebffdbe9cbc" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-9f05dad2-f375-4c89-ac13-eebffdbe9cbc" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f1bcfd-812d-4231-a08c-472baa24dc2b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:11 devstack sudo[92941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc
Apr 29 09:19:11 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:11 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-18e68fe0-e009-4f54-9d3f-06b932992506" released by "_copy_volume_from_snapshot" :: held 8.425s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-3387faca-8f29-4ede-bbb6-431b38be445e-18e68fe0-e009-4f54-9d3f-06b932992506" released by "_create_volume_from_snapshot" :: held 8.467s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.503s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.630s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-461690728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a31ac1-7e37-4d77-9046-3e5b67cecdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc489001c3914111b095aa90632f5857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:18:58Z,use_quota=True,user_id='bdba3a4bf3e3443e900ed942682c9c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Creating volume f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:11 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:11 devstack sudo[92944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc 1073741824
Apr 29 09:19:11 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28efd4ce-2f5a-450a-b2e6-e50b2e0b20ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e68fe0-e009-4f54-9d3f-06b932992506', 'volume_size': 1, 'snapshot_id': '3387faca-8f29-4ede-bbb6-431b38be445e'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85452cc-125f-4064-822d-2e2ee1d66536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:11 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Volume volume-18e68fe0-e009-4f54-9d3f-06b932992506 (18e68fe0-e009-4f54-9d3f-06b932992506): created successfully
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85452cc-125f-4064-822d-2e2ee1d66536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (72044635-fb3e-4cc9-981c-022eaf407a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:11 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-d40f4fcf-78c2-470a-9cb5-0e08f67df3df tempest-VolumeDependencyTests-333341022 None] Created volume successfully.
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-3387faca-8f29-4ede-bbb6-431b38be445e-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-3387faca-8f29-4ede-bbb6-431b38be445e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:11 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-3387faca-8f29-4ede-bbb6-431b38be445e" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:12 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-3387faca-8f29-4ede-bbb6-431b38be445e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Deleting offline snapshot 3387faca-8f29-4ede-bbb6-431b38be445e of volume d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:19:12 devstack sudo[92949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc
Apr 29 09:19:12 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] snapshot_file for this snap is: volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a447d-9b76-48fe-bccf-88d754992c4b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:12 devstack sudo[92951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e
Apr 29 09:19:12 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:12 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc 1073741824" returned: 0 in 0.829s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:12 devstack sudo[92958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc
Apr 29 09:19:12 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:12 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-9f05dad2-f375-4c89-ac13-eebffdbe9cbc" returned: 0 in 0.652s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-9f05dad2-f375-4c89-ac13-eebffdbe9cbc" released by "delete_volume" :: held 1.421s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Created reservations ['da2b2b20-ea9c-46f6-94c9-a67a18691905', '2f36784b-99d2-45cf-9ce2-5e325728ad7a', '612d1412-170c-4be4-ac6d-f3fc20b8a7b0', 'e74d7607-cbfb-435e-8482-d31b11c04d09'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:12 devstack sudo[92963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:12 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:12 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e" returned: 0 in 0.790s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[386a0e96-7913-402b-b9bc-f55e13cf1086]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:12 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:12 devstack sudo[92965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c
Apr 29 09:19:12 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:13 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" returned: 0 in 0.621s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.879s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-782317053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509da2d0-355a-41d2-8226-ffa0a10fc90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:01Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Creating volume 509da2d0-355a-41d2-8226-ffa0a10fc90d {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:13 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfac847b-27b2-4fc2-8aa6-a069e2ae51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19a572f-8a20-44de-86dc-cc39fa595025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:13 devstack sudo[92968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d 1073741824
Apr 29 09:19:13 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:13 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Volume volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc (f1a31ac1-7e37-4d77-9046-3e5b67cecdfc): created successfully
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e19a572f-8a20-44de-86dc-cc39fa595025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Flow 'volume_create_manager' (8a14e098-0d8c-4db1-a21b-24000bf20c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-7fcdf3c7-ab0e-4289-9948-34ca39003da9 tempest-SnapshotDependencyTests-1400575403 None] Created volume successfully.
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-6b755875-8781-4140-acba-aed48a6c925b-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-6b755875-8781-4140-acba-aed48a6c925b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:13 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.697s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:13 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Deleted volume successfully.
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-17d2a512-f4ab-4383-a07e-28e4fa25644f tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-9f05dad2-f375-4c89-ac13-eebffdbe9cbc-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-6b755875-8781-4140-acba-aed48a6c925b" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-6b755875-8781-4140-acba-aed48a6c925b" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ce8f7-0ab1-49c5-8ced-d3986a7c28d1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:13 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" returned: 0 in 0.783s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:13 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:13 devstack sudo[92975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e
Apr 29 09:19:13 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:13 devstack sudo[92974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b
Apr 29 09:19:13 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:14 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d 1073741824" returned: 0 in 0.868s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:14 devstack sudo[92981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d
Apr 29 09:19:14 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:14 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b" returned: 0 in 0.759s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:14 devstack sudo[92990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b
Apr 29 09:19:14 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:14 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e" returned: 0 in 0.778s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:14 devstack sudo[92993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e
Apr 29 09:19:14 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:14 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d" returned: 0 in 0.705s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.126s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Creating offline snapshot 8a333bf9-d517-42a9-b388-6eb7dafdfb59 of volume f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baff9f9-a433-4f06-949b-27c34866d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509da2d0-355a-41d2-8226-ffa0a10fc90d', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8be96cc-eded-42ef-b71f-54ce58a83eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b1549-6837-40e3-8fea-a47a1f409e48]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:14 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume volume-509da2d0-355a-41d2-8226-ffa0a10fc90d (509da2d0-355a-41d2-8226-ffa0a10fc90d): created successfully
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8be96cc-eded-42ef-b71f-54ce58a83eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:14 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (e8175960-e0ea-4be3-b54c-03fc0805cf6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:14 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-5fb234ff-172f-4637-8fbd-6e2f17b57678 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created volume successfully.
Apr 29 09:19:15 devstack sudo[92996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc
Apr 29 09:19:15 devstack sudo[92996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:15 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c.3387faca-8f29-4ede-bbb6-431b38be445e" returned: 0 in 0.646s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:15 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-6b755875-8781-4140-acba-aed48a6c925b" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-6b755875-8781-4140-acba-aed48a6c925b" released by "delete_volume" :: held 1.583s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-3387faca-8f29-4ede-bbb6-431b38be445e" released by "_delete_snapshot" :: held 3.141s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" released by "delete_snapshot" :: held 3.178s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Created reservations ['078f073c-6041-4888-bbb9-6e79552fe3e8', '22641516-816a-4968-bd58-02eee52d8ff2', 'd982bc1c-0d0d-40a1-b923-7c0e8921f0e8', 'd835d7c8-a1ac-4d78-af4c-453d46a451c4'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Created reservations ['1d866e52-a04d-4366-9e35-4bdc2501bb04', '82e991b1-0f0e-4eac-9c90-9d3f3a8c7f47', 'bd6e790c-c307-49ea-bdaf-1c583b5f7862', '63e96d74-f657-4a5f-b557-eccd4f5e1489'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:15 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Delete snapshot completed successfully.
Apr 29 09:19:15 devstack sudo[93000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:15 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-6ac93e3b-f631-4f86-baf8-df179f17d915 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-3387faca-8f29-4ede-bbb6-431b38be445e-delete_snapshot" released by "delete_snapshot" :: held 3.372s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:15 devstack sudo[92996]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-2fe23b0b-47b6-42b8-8a66-7f0fae830c31-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" returned: 0 in 0.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-2fe23b0b-47b6-42b8-8a66-7f0fae830c31-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:15 devstack sudo[93005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 1G
Apr 29 09:19:15 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-2fe23b0b-47b6-42b8-8a66-7f0fae830c31" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-2fe23b0b-47b6-42b8-8a66-7f0fae830c31" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee021a29-c810-4336-a4f4-545cb73b8c33]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:15 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (29aec3c0-5a4a-4e9b-9a6c-6fb793ecd340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ec9423-edb0-42cf-bd10-88c5bbd0efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ec9423-edb0-42cf-bd10-88c5bbd0efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746201066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f40a60-5fe2-429d-abc5-c019319f915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:16Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack sudo[93007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5562504-903a-4c3e-bd12-3315a8909959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:16 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5562504-903a-4c3e-bd12-3315a8909959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05179207-988a-483a-ad3b-4105bda35066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05179207-988a-483a-ad3b-4105bda35066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f40a60-5fe2-429d-abc5-c019319f915c', 'volume_name': 'volume-28f40a60-5fe2-429d-abc5-c019319f915c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c5fc2b-9f90-428c-ae05-9589ef9d927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c5fc2b-9f90-428c-ae05-9589ef9d927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acf19dd-bb72-42cb-ba39-87059ebc517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume 28f40a60-5fe2-429d-abc5-c019319f915c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f40a60-5fe2-429d-abc5-c019319f915c', 'volume_size': 1}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.844s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:16 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Deleted volume successfully.
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-32d1ebb9-60c3-47b6-aafa-4acc370a9eb4 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-6b755875-8781-4140-acba-aed48a6c925b-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-d1665c4a-2ca2-4ac3-b43f-70152a91d16c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Lock "cinder-d1665c4a-2ca2-4ac3-b43f-70152a91d16c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" acquired by "delete_volume" :: waited 0.043s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (ed795236-4d3d-40ac-8b71-3efc2f848ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0865beec-3baa-47ea-93f9-035b7a2bf152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[64973619-e504-40ab-9dbb-218b02eb09c7]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0865beec-3baa-47ea-93f9-035b7a2bf152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419613375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ef02c7-4ec2-4f9e-bf56-95a9706fa402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:16Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc403d65-2365-44e9-8a87-235696ec5ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc403d65-2365-44e9-8a87-235696ec5ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6a4191-a989-4323-8b3c-ff15cfdc58c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6a4191-a989-4323-8b3c-ff15cfdc58c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ef02c7-4ec2-4f9e-bf56-95a9706fa402', 'volume_name': 'volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c177d0-4c7a-4538-bef2-6fc649a871ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c177d0-4c7a-4538-bef2-6fc649a871ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61946f67-83f2-4397-81a3-7dc7beb67b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume 30ef02c7-4ec2-4f9e-bf56-95a9706fa402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402', 'volume_size': 1}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:16 devstack sudo[93013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c
Apr 29 09:19:16 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:16 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (feb11a85-990c-4e6c-b2ed-3392dbe2b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d198988b-07b1-4d9d-92c2-f14d2ec84eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 1G" returned: 0 in 1.205s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d198988b-07b1-4d9d-92c2-f14d2ec84eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-170078246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a6a1e6-d776-4a83-9be4-9b7e20ecef50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:17Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack sudo[93018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59
Apr 29 09:19:16 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49c8443-511d-40a3-9540-1ddb5ec55119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49c8443-511d-40a3-9540-1ddb5ec55119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469545e1-00fe-4162-8024-a85a8344c4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469545e1-00fe-4162-8024-a85a8344c4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a6a1e6-d776-4a83-9be4-9b7e20ecef50', 'volume_name': 'volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11a4685-00be-4948-8ce1-af9a040448e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:16 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11a4685-00be-4948-8ce1-af9a040448e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b756904e-832e-44a3-9802-3e544c23f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume 10a6a1e6-d776-4a83-9be4-9b7e20ecef50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50', 'volume_size': 1}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:17 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31" returned: 0 in 1.131s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:17 devstack sudo[93020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31
Apr 29 09:19:17 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (b9b6466f-0aa7-4f83-bccb-1341662d72cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27243be-f196-450d-b091-b7789fd17f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27243be-f196-450d-b091-b7789fd17f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127272570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8c8d90-814e-4bee-aa87-00334692ef92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:17Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16670492-ca89-4ab1-b35f-ab32b62ea7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16670492-ca89-4ab1-b35f-ab32b62ea7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb08438-6347-4004-af45-3bf34d3a01a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb08438-6347-4004-af45-3bf34d3a01a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8c8d90-814e-4bee-aa87-00334692ef92', 'volume_name': 'volume-7f8c8d90-814e-4bee-aa87-00334692ef92', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d1c26a-1a7d-4227-b54a-cd12938642c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d1c26a-1a7d-4227-b54a-cd12938642c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba477f2-b1b4-4b90-9347-b847c60682e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume 7f8c8d90-814e-4bee-aa87-00334692ef92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8c8d90-814e-4bee-aa87-00334692ef92', 'volume_size': 1}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:17 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" returned: 0 in 1.053s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:17 devstack sudo[93025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c
Apr 29 09:19:17 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:17 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:17 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59" returned: 0 in 0.923s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-2fe23b0b-47b6-42b8-8a66-7f0fae830c31" returned: 0 in 0.801s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:17 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 is being set with open permissions: ugo+rw
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:17 devstack sudo[93032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-2fe23b0b-47b6-42b8-8a66-7f0fae830c31" released by "delete_volume" :: held 2.013s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:17 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (19f13cfb-762f-4634-a510-ff30d6fc1ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0272d26b-78e2-4d8b-a300-9075a8472e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0272d26b-78e2-4d8b-a300-9075a8472e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812570592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bebf9cc-6599-4f0f-827a-2145f0ec20b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:18Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d87b71-c031-4b9c-b138-6a9cd940c0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d87b71-c031-4b9c-b138-6a9cd940c0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede65afe-13f5-4869-8b21-736158919a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede65afe-13f5-4869-8b21-736158919a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bebf9cc-6599-4f0f-827a-2145f0ec20b8', 'volume_name': 'volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0ddd41-8b1e-46a4-89ed-9eda4db1cef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0ddd41-8b1e-46a4-89ed-9eda4db1cef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07134f60-11cd-431f-bb3b-20b0de2e1683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:17 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume 4bebf9cc-6599-4f0f-827a-2145f0ec20b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8', 'volume_size': 1}
Apr 29 09:19:17 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Created reservations ['e2bfabfe-eca0-4ab4-940a-8294cdc355e7', 'e29d9cc6-5bd7-459b-b9b9-ea815fedfa80', 'e34bb091-8819-4ea6-974a-c01cb849934b', '11560e5d-0bc1-4f3b-a003-43c8b9094d84'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:18 devstack sudo[93034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:18 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:18 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" returned: 0 in 0.655s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-d1665c4a-2ca2-4ac3-b43f-70152a91d16c" released by "delete_volume" :: held 1.826s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Created reservations ['62709a54-f86e-4a39-9e3d-c669f918a9a8', 'b136a670-9a9c-4165-b6b0-aa627f7a6110', '8c5b0fa4-79a4-4367-b1d9-9efc623808f3', '70499cf4-2444-44e2-a4fa-da00ba156ef6'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:18 devstack sudo[93038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:18 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:18 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59" returned: 0 in 0.637s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:18 devstack sudo[93040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.info
Apr 29 09:19:18 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:18 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.635s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:18 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Deleted volume successfully.
Apr 29 09:19:18 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-de2ceca5-0f05-4c35-b359-570de6a5a7f3 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-2fe23b0b-47b6-42b8-8a66-7f0fae830c31-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (8203722c-2cf1-4445-a58c-7b2102efb29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:19 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3930d738-bd23-4cfb-a68e-ac6a648025b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.676s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Deleted volume successfully.
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3930d738-bd23-4cfb-a68e-ac6a648025b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-952839112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8d2f9f50254008a1c6d74533bc84a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:19Z,use_quota=True,user_id='3f325aebdec54626b5db7ffb8ccf77ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd71a32-47cf-4fc7-90f2-7710607c26f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd71a32-47cf-4fc7-90f2-7710607c26f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b0e68a-0ef3-4f61-a267-7405b52c1b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b0e68a-0ef3-4f61-a267-7405b52c1b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a', 'volume_name': 'volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed02f44-f4ef-40dd-8c7b-c8dd792d2b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed02f44-f4ef-40dd-8c7b-c8dd792d2b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd4a809-aa53-4d2c-bcb1-272704d0b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:19 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Volume dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a', 'volume_size': 1}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-157958ab-570f-4290-8b08-cf406aada7ae-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-83044ab3-7387-47c7-9cd3-d65e449711da tempest-VolumeDependencyTests-333341022 None] Lock "cinder-d1665c4a-2ca2-4ac3-b43f-70152a91d16c-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-157958ab-570f-4290-8b08-cf406aada7ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-26ae7d18-4b07-4d17-9af8-53bda4943e8b" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-26ae7d18-4b07-4d17-9af8-53bda4943e8b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-157958ab-570f-4290-8b08-cf406aada7ae" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-157958ab-570f-4290-8b08-cf406aada7ae" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Deleting offline snapshot 157958ab-570f-4290-8b08-cf406aada7ae of volume 26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:19:19 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] snapshot_file for this snap is: volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.info" returned: 0 in 0.674s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:19 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.info is being set with open permissions: ugo+rw
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbdb3d0-4c19-45d3-9532-44dc097a5501]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:19 devstack sudo[93045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.info
Apr 29 09:19:19 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:19 devstack sudo[93046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae
Apr 29 09:19:19 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:19 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.info" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.692s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1746201066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f40a60-5fe2-429d-abc5-c019319f915c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:16Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Creating volume 28f40a60-5fe2-429d-abc5-c019319f915c {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:19 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:19 devstack sudo[93053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c 1073741824
Apr 29 09:19:19 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:19 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c18a6a0f-8f26-4ff4-ac9b-943465534cdd tempest-SnapshotDependencyTests-1400575403 None] Create snapshot completed successfully
Apr 29 09:19:19 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:19 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe0e5a2-728d-4a39-bc7d-a01844d585f5]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:20 devstack sudo[93056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b
Apr 29 09:19:20 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Flow 'volume_create_manager' (0134df88-5e65-4c4b-b28f-3e676f795d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07622f6f-271a-4675-8f3b-cb2586f2e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07622f6f-271a-4675-8f3b-cb2586f2e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc489001c3914111b095aa90632f5857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a333bf9-d517-42a9-b388-6eb7dafdfb59,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:21Z,use_quota=True,user_id='bdba3a4bf3e3443e900ed942682c9c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4833e0-83fb-4ab9-97a8-0392850d7d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4833e0-83fb-4ab9-97a8-0392850d7d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef0fc31-7bb9-4c96-8d6f-f9495103cfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef0fc31-7bb9-4c96-8d6f-f9495103cfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6', 'volume_name': 'volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6', 'volume_size': 1, 'snapshot_id': '8a333bf9-d517-42a9-b388-6eb7dafdfb59'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bafbc19-1ac9-487a-870f-de9bdb37bef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:20 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bafbc19-1ac9-487a-870f-de9bdb37bef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0586f9-6006-4092-be86-e23401d72f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:20 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Volume 8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6', 'volume_size': 1, 'snapshot_id': '8a333bf9-d517-42a9-b388-6eb7dafdfb59'}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c 1073741824" returned: 0 in 0.875s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:20 devstack sudo[93065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c
Apr 29 09:19:20 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:20 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b" returned: 0 in 0.772s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:20 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:20 devstack sudo[93067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae
Apr 29 09:19:20 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:21 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c" returned: 0 in 0.585s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.722s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1419613375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ef02c7-4ec2-4f9e-bf56-95a9706fa402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:16Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Creating volume 30ef02c7-4ec2-4f9e-bf56-95a9706fa402 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:21 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6acf19dd-bb72-42cb-ba39-87059ebc517e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f40a60-5fe2-429d-abc5-c019319f915c', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:21 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402 1073741824
Apr 29 09:19:21 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2159ef20-bc40-4a08-91dc-40ab021708c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:21 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume volume-28f40a60-5fe2-429d-abc5-c019319f915c (28f40a60-5fe2-429d-abc5-c019319f915c): created successfully
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2159ef20-bc40-4a08-91dc-40ab021708c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (29aec3c0-5a4a-4e9b-9a6c-6fb793ecd340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:21 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-97461afb-5f15-4259-ab67-259056e56258 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created volume successfully.
Apr 29 09:19:21 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae" returned: 0 in 0.738s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:21 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:21 devstack sudo[93075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae
Apr 29 09:19:21 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:22 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:22 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b.157958ab-570f-4290-8b08-cf406aada7ae" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402 1073741824" returned: 0 in 0.828s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-157958ab-570f-4290-8b08-cf406aada7ae" released by "_delete_snapshot" :: held 3.019s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-26ae7d18-4b07-4d17-9af8-53bda4943e8b" released by "delete_snapshot" :: held 3.043s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:22 devstack sudo[93082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402
Apr 29 09:19:22 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Created reservations ['80b1a74c-8779-44a8-873b-190e051c9dd0', '86af7bf8-1d5f-488a-92f9-5d8c3affa10f', 'd2c86379-25de-4011-96c1-5a7f1f9b8371', 'e87c7bdd-d470-4fa1-9245-f1a0d62c1455'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Delete snapshot completed successfully.
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-b1211e8e-c7fe-41f6-a185-2f893dd4889b tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-157958ab-570f-4290-8b08-cf406aada7ae-delete_snapshot" released by "delete_snapshot" :: held 3.197s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:22 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.838s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-170078246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a6a1e6-d776-4a83-9be4-9b7e20ecef50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:17Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Creating volume 10a6a1e6-d776-4a83-9be4-9b7e20ecef50 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:22 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61946f67-83f2-4397-81a3-7dc7beb67b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:22 devstack sudo[93085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50 1073741824
Apr 29 09:19:22 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85185048-a7f5-45eb-9f0c-a5511698c20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:22 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402 (30ef02c7-4ec2-4f9e-bf56-95a9706fa402): created successfully
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85185048-a7f5-45eb-9f0c-a5511698c20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:22 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (ed795236-4d3d-40ac-8b71-3efc2f848ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:22 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4de00d53-a1cc-4afb-87e5-9c4914e26111 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created volume successfully.
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-26ae7d18-4b07-4d17-9af8-53bda4943e8b-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-26ae7d18-4b07-4d17-9af8-53bda4943e8b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "cinder-quobyte-26ae7d18-4b07-4d17-9af8-53bda4943e8b" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-26ae7d18-4b07-4d17-9af8-53bda4943e8b" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed722b73-bf8b-48c8-855d-fb56c8ea72b1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:23 devstack sudo[93091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b
Apr 29 09:19:23 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:23 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50 1073741824" returned: 0 in 0.805s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:23 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:23 devstack sudo[93093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50
Apr 29 09:19:23 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:24 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b" returned: 0 in 0.759s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:24 devstack sudo[93139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b
Apr 29 09:19:24 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:24 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50" returned: 0 in 0.671s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.893s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127272570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8c8d90-814e-4bee-aa87-00334692ef92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:17Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Creating volume 7f8c8d90-814e-4bee-aa87-00334692ef92 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:24 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b756904e-832e-44a3-9802-3e544c23f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:24 devstack sudo[93143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92 1073741824
Apr 29 09:19:24 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d0656d-1604-4f9d-8652-4c472353d0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:24 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50 (10a6a1e6-d776-4a83-9be4-9b7e20ecef50): created successfully
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d0656d-1604-4f9d-8652-4c472353d0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (feb11a85-990c-4e6c-b2ed-3392dbe2b981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:24 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-a70bd884-8ac3-4725-ae88-268dbd32223b tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created volume successfully.
Apr 29 09:19:24 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-26ae7d18-4b07-4d17-9af8-53bda4943e8b" returned: 0 in 0.635s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-quobyte-26ae7d18-4b07-4d17-9af8-53bda4943e8b" released by "delete_volume" :: held 1.455s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Created reservations ['2d249e5f-11a7-4344-8143-94ea5247d5e5', 'f76eb069-dc40-4c9e-9651-4540f642b597', 'dadca674-edfc-4ef4-b84c-3aa637929cb5', '15019f0d-1bc2-422b-a562-afca1d1d33ca'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:24 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:25 devstack sudo[93150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:25 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:25 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92 1073741824" returned: 0 in 0.837s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:25 devstack sudo[93153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92
Apr 29 09:19:25 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:25 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.627s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Deleted volume successfully.
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e019fb9f-809a-43be-a57a-70d95c1a63b2 tempest-CreateVolumesFromSnapshotTest-223925229 None] Lock "cinder-26ae7d18-4b07-4d17-9af8-53bda4943e8b-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:25 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92" returned: 0 in 0.626s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.888s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-812570592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bebf9cc-6599-4f0f-827a-2145f0ec20b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f374fe5350294fdabbadd458dcf29e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:18Z,use_quota=True,user_id='fcf2dd6f4cfc40d5a20ecd71269d0750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Creating volume 4bebf9cc-6599-4f0f-827a-2145f0ec20b8 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:25 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ba477f2-b1b4-4b90-9347-b847c60682e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8c8d90-814e-4bee-aa87-00334692ef92', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:25 devstack sudo[93157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8 1073741824
Apr 29 09:19:25 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd5fe91-dba3-4a76-8e43-daa99250edf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:25 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume volume-7f8c8d90-814e-4bee-aa87-00334692ef92 (7f8c8d90-814e-4bee-aa87-00334692ef92): created successfully
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd5fe91-dba3-4a76-8e43-daa99250edf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:25 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (b9b6466f-0aa7-4f83-bccb-1341662d72cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:25 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0fc382fb-e219-4178-9437-6fd006586c8a tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created volume successfully.
Apr 29 09:19:26 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8 1073741824" returned: 0 in 0.862s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:26 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:26 devstack sudo[93163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8
Apr 29 09:19:26 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:27 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8" returned: 0 in 0.642s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.311s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-952839112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8d2f9f50254008a1c6d74533bc84a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:19Z,use_quota=True,user_id='3f325aebdec54626b5db7ffb8ccf77ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Creating volume dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:27 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:27 devstack sudo[93167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a 1073741824
Apr 29 09:19:27 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07134f60-11cd-431f-bb3b-20b0de2e1683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95460e1-42fc-4ffc-aa58-98d4176d2117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:27 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Volume volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8 (4bebf9cc-6599-4f0f-827a-2145f0ec20b8): created successfully
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b95460e1-42fc-4ffc-aa58-98d4176d2117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Flow 'volume_create_manager' (19f13cfb-762f-4634-a510-ff30d6fc1ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:27 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-f997e128-6548-4171-9471-f5581584b01f tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created volume successfully.
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-4bebf9cc-6599-4f0f-827a-2145f0ec20b8-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-4bebf9cc-6599-4f0f-827a-2145f0ec20b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-quobyte-4bebf9cc-6599-4f0f-827a-2145f0ec20b8" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-4bebf9cc-6599-4f0f-827a-2145f0ec20b8" acquired by "delete_volume" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad18dda-179c-4121-a442-f9ce4008e344]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:27 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:27 devstack sudo[93169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8
Apr 29 09:19:27 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:28 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a 1073741824" returned: 0 in 0.865s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:28 devstack sudo[93175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a
Apr 29 09:19:28 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:28 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Flow 'volume_create_manager' (e7f119f7-49a7-472f-b7ef-20e8da8821d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6636bd75-a767-4b66-816c-f37f8fb85826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8" returned: 0 in 0.896s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6636bd75-a767-4b66-816c-f37f8fb85826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831c431e-2e21-4fea-995f-df868fc22e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d00f003cd64cdf8f64a799360cbab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:29Z,use_quota=True,user_id='613e00d6d2aa4b26bee2b30f009da942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:28 devstack sudo[93180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8
Apr 29 09:19:28 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4f9c65-fed2-4f34-b213-5b7e45393caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4f9c65-fed2-4f34-b213-5b7e45393caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c82c3f4-37ee-4f0f-8efa-1bb135b46709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c82c3f4-37ee-4f0f-8efa-1bb135b46709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831c431e-2e21-4fea-995f-df868fc22e87', 'volume_name': 'volume-831c431e-2e21-4fea-995f-df868fc22e87', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96ea29b-9cbd-49c4-91f2-e38d32b07d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d96ea29b-9cbd-49c4-91f2-e38d32b07d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4badb56b-bd00-41ae-9556-d08788a9e6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:28 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Volume 831c431e-2e21-4fea-995f-df868fc22e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831c431e-2e21-4fea-995f-df868fc22e87', 'volume_size': 1}
Apr 29 09:19:28 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:29 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" returned: 0 in 0.691s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.345s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-quobyte-8a333bf9-d517-42a9-b388-6eb7dafdfb59-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" by "_create_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd4a809-aa53-4d2c-bcb1-272704d0b837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0636af24-ef5e-44a2-bd79-cf81105d08f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8a333bf9-d517-42a9-b388-6eb7dafdfb59-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Creating volume 8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 from snapshot 8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-quobyte-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] snapshot: 8a333bf9-d517-42a9-b388-6eb7dafdfb59, volume: 8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:19:29 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Volume volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a (dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a): created successfully
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0636af24-ef5e-44a2-bd79-cf81105d08f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (8203722c-2cf1-4445-a58c-7b2102efb29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:29 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-0b360bc0-b979-4a37-8fa3-0dd6f7a2aa18 tempest-VolumeDependencyTests-333341022 None] Created volume successfully.
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[621cbb8b-c15d-4429-a5b4-c8af3be9a9bf]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:29 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-4bebf9cc-6599-4f0f-827a-2145f0ec20b8" returned: 0 in 0.601s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:29 devstack sudo[93183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59
Apr 29 09:19:29 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-4bebf9cc-6599-4f0f-827a-2145f0ec20b8" released by "delete_volume" :: held 1.548s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created reservations ['a134146c-86e7-4cf7-99cd-776af19939f4', '453d8c59-3b54-4d99-b403-cdba8470be76', '403028cc-cb7b-4292-be4f-3449b505d51f', 'c0302548-3583-4978-ac8c-16fe304fa721'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:29 devstack sudo[93186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:29 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-7f8c8d90-814e-4bee-aa87-00334692ef92-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:29 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59" returned: 0 in 0.795s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:19:29 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-7f8c8d90-814e-4bee-aa87-00334692ef92-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e36a57f-d920-4325-9481-dd8719b3d9b2]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-quobyte-7f8c8d90-814e-4bee-aa87-00334692ef92" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-7f8c8d90-814e-4bee-aa87-00334692ef92" acquired by "delete_volume" :: waited 0.039s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[38600252-4a69-4661-a5bb-6feba1372052]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:30 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.764s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:30 devstack sudo[93192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:30 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:30 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Deleted volume successfully.
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (c16424ca-501a-4e40-b987-c2634a27d2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e82b011-c870-4bbb-b992-554a1c80249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e82b011-c870-4bbb-b992-554a1c80249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1009312409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59b193b-234d-46e8-8c5b-4ecba593c940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc8d2f9f50254008a1c6d74533bc84a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:30Z,use_quota=True,user_id='3f325aebdec54626b5db7ffb8ccf77ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba72aeb3-36e8-4adf-b39a-52def87970a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba72aeb3-36e8-4adf-b39a-52def87970a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3ed94a-c591-4e00-bebf-369b25663322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:30 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92
Apr 29 09:19:30 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3ed94a-c591-4e00-bebf-369b25663322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b59b193b-234d-46e8-8c5b-4ecba593c940', 'volume_name': 'volume-b59b193b-234d-46e8-8c5b-4ecba593c940', 'volume_size': 1, 'source_volid': 'dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839e4fff-4eff-4d69-9b17-eb317052e7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839e4fff-4eff-4d69-9b17-eb317052e7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96dd868-9fbe-490a-8d0b-d139d596d30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:30 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Volume b59b193b-234d-46e8-8c5b-4ecba593c940: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b59b193b-234d-46e8-8c5b-4ecba593c940', 'volume_size': 1, 'source_volid': 'dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a', 'source_volstatus': 'available'}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-509de3c0-2bd4-4e82-bbaf-8a4f1b4d6b84 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-4bebf9cc-6599-4f0f-827a-2145f0ec20b8-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:30 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" returned: 0 in 0.805s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:30 devstack sudo[93203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6
Apr 29 09:19:30 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:30 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92" returned: 0 in 0.734s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:30 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:30 devstack sudo[93205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92
Apr 29 09:19:30 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:31 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-7f8c8d90-814e-4bee-aa87-00334692ef92" returned: 0 in 0.676s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-7f8c8d90-814e-4bee-aa87-00334692ef92" released by "delete_volume" :: held 1.488s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created reservations ['7ab838ea-54c8-4dc8-b791-54431bd2b756', '30ba0d39-9149-4459-8c5e-266038758a28', '0f47ebe2-d13e-454b-a7c0-89de76cc75fa', '40ea6b68-be89-4fe3-afdf-c687bad39ef6'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:31 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:31 devstack sudo[93218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:31 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-10a6a1e6-d776-4a83-9be4-9b7e20ecef50-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-10a6a1e6-d776-4a83-9be4-9b7e20ecef50-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:32 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=136,cinder:UPDATE=192,cinder:DELETE=19,cinder:INSERT=35 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:19:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-quobyte-10a6a1e6-d776-4a83-9be4-9b7e20ecef50" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:32 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-10a6a1e6-d776-4a83-9be4-9b7e20ecef50" acquired by "delete_volume" :: waited 0.032s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:32 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bec524-4863-4687-8430-107b5bb6a052]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:32 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:33 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50
Apr 29 09:19:33 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:33 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.168s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:33 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:33 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Deleted volume successfully.
Apr 29 09:19:33 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=144,cinder:UPDATE=191,cinder:INSERT=52,cinder:DELETE=19 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:19:33 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-578b4ca6-3995-4540-8d36-182732117230 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-7f8c8d90-814e-4bee-aa87-00334692ef92-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:33 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50" returned: 0 in 1.161s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:33 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:34 devstack sudo[93226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50
Apr 29 09:19:34 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:35 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-10a6a1e6-d776-4a83-9be4-9b7e20ecef50" returned: 0 in 1.313s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-10a6a1e6-d776-4a83-9be4-9b7e20ecef50" released by "delete_volume" :: held 2.581s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created reservations ['580ead28-4c0a-490e-9ee3-b1fd9dfc036e', '639154e0-0c29-42be-b54b-cd0d419865a6', 'e8fae82c-d1da-4c13-ba11-8d40b88a7441', '77b05b84-6097-40c1-a1a8-7bfe267ea403'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:35 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:35 devstack sudo[93230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:35 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:36 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" returned: 0 in 5.235s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[068d9cdb-67d5-4838-b227-32ce031e2250]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:36 devstack sudo[93232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc
Apr 29 09:19:36 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-30ef02c7-4ec2-4f9e-bf56-95a9706fa402-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-30ef02c7-4ec2-4f9e-bf56-95a9706fa402-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-quobyte-30ef02c7-4ec2-4f9e-bf56-95a9706fa402" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-30ef02c7-4ec2-4f9e-bf56-95a9706fa402" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d996aa4-75a7-4d40-8a87-f1296d272269]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:36 devstack sudo[93234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402
Apr 29 09:19:36 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:36 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.819s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:36 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Deleted volume successfully.
Apr 29 09:19:36 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-74fcec1c-91d7-4881-be92-47b6e6683752 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-10a6a1e6-d776-4a83-9be4-9b7e20ecef50-delete_volume" released by "delete_volume" :: held 3.914s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:37 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" returned: 0 in 0.975s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:19:37 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Converted 1024.00 MB image at 195.53 MB/s
Apr 29 09:19:37 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 is being set with open permissions: ugo+rw
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:37 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402" returned: 0 in 0.736s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:37 devstack sudo[93243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6
Apr 29 09:19:37 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:37 devstack sudo[93244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402
Apr 29 09:19:37 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:37 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-30ef02c7-4ec2-4f9e-bf56-95a9706fa402" returned: 0 in 0.578s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:37 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" returned: 0 in 0.605s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-30ef02c7-4ec2-4f9e-bf56-95a9706fa402" released by "delete_volume" :: held 1.355s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" released by "_copy_volume_from_snapshot" :: held 8.540s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8a333bf9-d517-42a9-b388-6eb7dafdfb59-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" released by "_create_volume_from_snapshot" :: held 8.583s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.619s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.923s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831c431e-2e21-4fea-995f-df868fc22e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d00f003cd64cdf8f64a799360cbab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:29Z,use_quota=True,user_id='613e00d6d2aa4b26bee2b30f009da942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Creating volume 831c431e-2e21-4fea-995f-df868fc22e87 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:37 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:37 devstack sudo[93249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87 1073741824
Apr 29 09:19:37 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0586f9-6006-4092-be86-e23401d72f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6', 'volume_size': 1, 'snapshot_id': '8a333bf9-d517-42a9-b388-6eb7dafdfb59'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b30e7bc-7f86-4a49-99ed-992d31411cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:37 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Volume volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 (8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6): created successfully
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b30e7bc-7f86-4a49-99ed-992d31411cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Flow 'volume_create_manager' (0134df88-5e65-4c4b-b28f-3e676f795d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created reservations ['e881c09a-de3c-4250-9803-16153b1be919', '21d1c20c-ae5d-40b8-8b3a-c883221d29c4', 'c684be20-df87-4338-9b75-a0f8864fc036', '87a2b92e-f581-40f8-859f-91af87175216'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:37 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-ed0017fd-7517-401b-9a0b-0ff9441c3f5f tempest-SnapshotDependencyTests-1400575403 None] Created volume successfully.
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:37 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:37 devstack sudo[93251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:37 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-8a333bf9-d517-42a9-b388-6eb7dafdfb59-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-8a333bf9-d517-42a9-b388-6eb7dafdfb59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-quobyte-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-quobyte-8a333bf9-d517-42a9-b388-6eb7dafdfb59" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8a333bf9-d517-42a9-b388-6eb7dafdfb59" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Deleting offline snapshot 8a333bf9-d517-42a9-b388-6eb7dafdfb59 of volume f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] snapshot_file for this snap is: volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ea57dd-dd1a-4aa9-862d-141aba520a8e]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:38 devstack sudo[93253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59
Apr 29 09:19:38 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-28f40a60-5fe2-429d-abc5-c019319f915c-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-28f40a60-5fe2-429d-abc5-c019319f915c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:38 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.681s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:38 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Deleted volume successfully.
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-57624aec-56b2-46ac-be35-a36f5a7ef5ba tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-30ef02c7-4ec2-4f9e-bf56-95a9706fa402-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-quobyte-28f40a60-5fe2-429d-abc5-c019319f915c" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-28f40a60-5fe2-429d-abc5-c019319f915c" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:38 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[85318ec0-5f68-4e72-b90e-6dfa0f4f5b7a]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87 1073741824" returned: 0 in 0.950s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:38 devstack sudo[93262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87
Apr 29 09:19:38 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:38 devstack sudo[93261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c
Apr 29 09:19:38 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:38 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59" returned: 0 in 0.836s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:38 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d66611b-9366-4ef1-a54f-27f093b845fd]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:39 devstack sudo[93268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc
Apr 29 09:19:39 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:39 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87" returned: 0 in 0.595s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.920s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:39 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Cloning volume dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a to volume b59b193b-234d-46e8-8c5b-4ecba593c940
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4badb56b-bd00-41ae-9556-d08788a9e6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831c431e-2e21-4fea-995f-df868fc22e87', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e14491-36e1-42c1-93d8-b93ad9e93191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:39 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Volume volume-831c431e-2e21-4fea-995f-df868fc22e87 (831c431e-2e21-4fea-995f-df868fc22e87): created successfully
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e14491-36e1-42c1-93d8-b93ad9e93191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Flow 'volume_create_manager' (e7f119f7-49a7-472f-b7ef-20e8da8821d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:39 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cd1df0d3-2f2d-4417-bd3a-f60a75b1d48b tempest-CinderUnicodeTest-1426668885 None] Created volume successfully.
Apr 29 09:19:39 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Creating offline snapshot 6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 of volume dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c" returned: 0 in 0.719s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba6a65-6073-46dd-ba8b-af7c30819ec2]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:39 devstack sudo[93274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c
Apr 29 09:19:39 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:39 devstack sudo[93275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a
Apr 29 09:19:39 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:39 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" returned: 0 in 0.754s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:39 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:39 devstack sudo[93281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59
Apr 29 09:19:39 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:40 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-28f40a60-5fe2-429d-abc5-c019319f915c" returned: 0 in 0.697s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-28f40a60-5fe2-429d-abc5-c019319f915c" released by "delete_volume" :: held 1.463s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created reservations ['30e9848d-f7c6-4491-9883-f45a2b095669', 'ecd4f7f1-bd2a-444b-a913-b066698d4a04', '4b4ce68e-a429-46b5-87a2-d3e18aa5cde3', 'e22af1b4-22ec-47fa-90cd-7a6f901c2d68'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:40 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" returned: 0 in 0.872s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:40 devstack sudo[93287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 1G
Apr 29 09:19:40 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:40 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.flows.manager.create_volume [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}}
Apr 29 09:19:40 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Flow 'volume_create_manager' (3f19f458-516c-4161-9f34-9d0d956af02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eb8d88-3011-4fd9-b537-d9c785d142a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28eb8d88-3011-4fd9-b537-d9c785d142a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1428916275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec200cc-3434-4f22-a8dc-1800b4548614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d00f003cd64cdf8f64a799360cbab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:40Z,use_quota=True,user_id='613e00d6d2aa4b26bee2b30f009da942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3592d11-08ea-465b-9537-0ce7d0103870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3592d11-08ea-465b-9537-0ce7d0103870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23fab61-7a08-40a4-ad7d-ac86f00a0b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23fab61-7a08-40a4-ad7d-ac86f00a0b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eec200cc-3434-4f22-a8dc-1800b4548614', 'volume_name': 'volume-eec200cc-3434-4f22-a8dc-1800b4548614', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09db1352-8b7a-4d18-8b57-004973d40b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09db1352-8b7a-4d18-8b57-004973d40b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e51d51b-853c-418d-9979-c73530bff544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:40 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Volume eec200cc-3434-4f22-a8dc-1800b4548614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eec200cc-3434-4f22-a8dc-1800b4548614', 'volume_size': 1}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:40 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59" returned: 0 in 0.840s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:40 devstack sudo[93295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59
Apr 29 09:19:40 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-509da2d0-355a-41d2-8226-ffa0a10fc90d-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-509da2d0-355a-41d2-8226-ffa0a10fc90d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "cinder-quobyte-509da2d0-355a-41d2-8226-ffa0a10fc90d" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-509da2d0-355a-41d2-8226-ffa0a10fc90d" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1f3f0d-ccf4-4435-aac3-b4c157a968bc]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:40 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:41 devstack sudo[93300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d
Apr 29 09:19:41 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:41 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.764s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Deleted volume successfully.
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-eb743d84-7f47-44a9-a803-0d844fa03cb3 tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-28f40a60-5fe2-429d-abc5-c019319f915c-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:41 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 1G" returned: 0 in 0.861s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:41 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2
Apr 29 09:19:41 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:41 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc.8a333bf9-d517-42a9-b388-6eb7dafdfb59" returned: 0 in 0.687s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8a333bf9-d517-42a9-b388-6eb7dafdfb59" released by "_delete_snapshot" :: held 3.248s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" released by "delete_snapshot" :: held 3.275s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Created reservations ['9c73f601-0bc1-4e9b-abb5-0e076015195e', '1c72fef6-485a-45d1-9ceb-4d2f4adad766', 'cddc9003-1504-4399-8c2b-27c453254fa0', 'e00fd156-eef3-4ae2-9ff9-280a0d021b23'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:41 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Delete snapshot completed successfully.
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-9a5711a3-901e-488b-92cc-84eb7628c6b2 tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-8a333bf9-d517-42a9-b388-6eb7dafdfb59-delete_snapshot" released by "delete_snapshot" :: held 3.416s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:41 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d" returned: 0 in 0.722s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:41 devstack sudo[93314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d
Apr 29 09:19:41 devstack sudo[93314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:41 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" returned: 0 in 0.694s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:41 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 is being set with open permissions: ugo+rw
Apr 29 09:19:41 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:41 devstack sudo[93317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2
Apr 29 09:19:41 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:42 devstack sudo[93314]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-509da2d0-355a-41d2-8226-ffa0a10fc90d" returned: 0 in 0.596s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-quobyte-509da2d0-355a-41d2-8226-ffa0a10fc90d" released by "delete_volume" :: held 1.368s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Created reservations ['5ecee6f5-c7a6-449a-8d34-d2c673c1e181', 'a2775c91-be37-4323-bea2-904bdd5c281e', '049fe838-ff9d-496a-aba5-95d2c90ffa56', 'c5f7b8d2-8efb-4abb-ab17-84a77bea2af6'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:42 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-quobyte-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:42 devstack sudo[93321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:42 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" acquired by "delete_volume" :: waited 0.067s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:42 devstack sudo[93323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.info
Apr 29 09:19:42 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681a838-50a6-485e-bcf4-1a0b9cf97dd3]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:42 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:42 devstack sudo[93325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc
Apr 29 09:19:42 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:43 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.639s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:43 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Deleted volume successfully.
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-aa27ffca-05f0-4d82-aff2-583649463dbd tempest-CreateVolumesFromSourceVolumeTest-1095266298 None] Lock "cinder-509da2d0-355a-41d2-8226-ffa0a10fc90d-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:43 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.info" returned: 0 in 0.658s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:43 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.info is being set with open permissions: ugo+rw
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:43 devstack sudo[93330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.info
Apr 29 09:19:43 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:43 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:43 devstack sudo[93334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc
Apr 29 09:19:43 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:43 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.info" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-b59b193b-234d-46e8-8c5b-4ecba593c940" by "_copy_volume_from_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-b59b193b-234d-46e8-8c5b-4ecba593c940" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] snapshot: 6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2, volume: b59b193b-234d-46e8-8c5b-4ecba593c940,  {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4dadd-2654-4ffb-ad95-170e14d0a732]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:43 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:44 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" returned: 0 in 0.707s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:44 devstack sudo[93338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2
Apr 29 09:19:44 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc" released by "delete_volume" :: held 1.534s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Created reservations ['43de1a54-b30d-4b65-9b26-e43e00c81649', '7c6c02d2-d7a3-4a9a-8266-b9b867d233e9', '0cb7b6b1-52c4-42e3-af01-334edda5b6ad', '0d2cce0b-4f48-4d90-bf7a-d38ad0826cd3'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:44 devstack sudo[93340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:44 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:44 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" returned: 0 in 0.829s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] will copy from snapshot at /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Creating direct copy from snapshot {{(pid=83863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dd9c70-fe01-479a-aac3-053bb5ad7aee]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:44 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.633s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:44 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Deleted volume successfully.
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-45f952f7-c983-493b-956c-d454ae954d5b tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-f1a31ac1-7e37-4d77-9046-3e5b67cecdfc-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:44 devstack sudo[93347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a
Apr 29 09:19:44 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "cinder-quobyte-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa31351-6966-4410-9640-1780f327b57c]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:44 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:45 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6
Apr 29 09:19:45 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:45 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" returned: 0 in 0.748s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:45 devstack cinder-volume[83863]: DEBUG cinder.utils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Path /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940 not found in is_blk_device check {{(pid=83863) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 29 09:19:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:45 devstack sudo[93354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940
Apr 29 09:19:45 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:45 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" returned: 0 in 0.745s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:45 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:45 devstack sudo[93359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6
Apr 29 09:19:45 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:46 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" returned: 0 in 0.592s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-quobyte-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6" released by "delete_volume" :: held 1.397s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Created reservations ['f6760eac-7fbc-40e2-947d-a2b91f0774ae', '20f4dc70-bff4-48d1-9dd6-ded37742d605', '3eb92f40-65b8-4d9e-ba6a-56c4cf260447', 'd3f653cd-aae4-4a98-841f-64bd6567e533'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:46 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:46 devstack sudo[93374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:46 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:47 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:47 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 1.107s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:47 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:47 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Deleted volume successfully.
Apr 29 09:19:47 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-cd3ede44-ddd8-4c56-a3d6-ff004593dcab tempest-SnapshotDependencyTests-1400575403 None] Lock "cinder-8e6b0f21-cb3f-4411-91a1-b52ef32cbdf6-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:50 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940" returned: 0 in 5.243s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:50 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b275bf-4eac-4899-8360-9cbe27636731]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:50 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:50 devstack sudo[93378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a
Apr 29 09:19:50 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:51 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" returned: 0 in 0.901s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:51 devstack cinder-volume[83863]: DEBUG cinder.image.image_utils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Image conversion details: src /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940 {{(pid=83863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 29 09:19:51 devstack cinder-volume[83863]: INFO cinder.image.image_utils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Converted 1024.00 MB image at 195.28 MB/s
Apr 29 09:19:51 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940 is being set with open permissions: ugo+rw
Apr 29 09:19:51 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:51 devstack sudo[93383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940
Apr 29 09:19:51 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:52 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940" returned: 0 in 0.672s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-b59b193b-234d-46e8-8c5b-4ecba593c940" released by "_copy_volume_from_snapshot" :: held 8.493s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Deleting offline snapshot 6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 of volume dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] snapshot_file for this snap is: volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[75061e0c-c678-4ff6-b42a-a8cf43dde6f9]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:52 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:52 devstack sudo[93386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2
Apr 29 09:19:52 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:53 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" returned: 0 in 0.771s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:53 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:19:53 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd6c263-429c-4e93-9c0c-f0a2d83c5b3b]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:53 devstack sudo[93392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a
Apr 29 09:19:53 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:53 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" returned: 0 in 0.715s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:53 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:54 devstack sudo[93398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2
Apr 29 09:19:54 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:54 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" returned: 0 in 0.741s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:54 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:54 devstack sudo[93404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2
Apr 29 09:19:54 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:55 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a.6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" returned: 0 in 0.637s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-6b3cc70f-cb25-48c9-a2f8-5231bd6d93f2" released by "_delete_snapshot" :: held 2.999s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.181s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.035s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76491ea00fb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-29T07:19:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1428916275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eec200cc-3434-4f22-a8dc-1800b4548614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d00f003cd64cdf8f64a799360cbab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T07:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T07:19:40Z,use_quota=True,user_id='613e00d6d2aa4b26bee2b30f009da942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c40170-a8ea-4fd1-b4dc-804117f325f7),volume_type_id=57c40170-a8ea-4fd1-b4dc-804117f325f7)}" {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Creating volume eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Selected osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d as target Quobyte volume. {{(pid=83863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 29 09:19:55 devstack cinder-volume[83863]: INFO cinder.volume.drivers.remotefs [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] casted to osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 1073741824 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:55 devstack sudo[93407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 1073741824
Apr 29 09:19:55 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96dd868-9fbe-490a-8d0b-d139d596d30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59b193b-234d-46e8-8c5b-4ecba593c940', 'volume_size': 1, 'source_volid': 'dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a', 'source_volstatus': 'available'}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10622437-b4db-4a9c-aa95-2f74583a70e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:55 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Volume volume-b59b193b-234d-46e8-8c5b-4ecba593c940 (b59b193b-234d-46e8-8c5b-4ecba593c940): created successfully
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10622437-b4db-4a9c-aa95-2f74583a70e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:55 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Flow 'volume_create_manager' (c16424ca-501a-4e40-b987-c2634a27d2a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:55 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-c92e8a53-8b4b-415a-b899-37da4aab2a5b tempest-VolumeDependencyTests-333341022 None] Created volume successfully.
Apr 29 09:19:56 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 1073741824" returned: 0 in 0.825s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:56 devstack sudo[93414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614
Apr 29 09:19:56 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" acquired by "delete_volume" :: waited 0.019s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0d3136-1517-4522-b93d-330b17753090]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:56 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:56 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a
Apr 29 09:19:56 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:57 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614" returned: 0 in 0.709s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'} {{(pid=83863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e51d51b-853c-418d-9979-c73530bff544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eec200cc-3434-4f22-a8dc-1800b4548614', 'volume_size': 1}' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3585c866-8f97-4050-9eda-7bc3e0cd0200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}}
Apr 29 09:19:57 devstack cinder-volume[83863]: INFO cinder.volume.flows.manager.create_volume [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Volume volume-eec200cc-3434-4f22-a8dc-1800b4548614 (eec200cc-3434-4f22-a8dc-1800b4548614): created successfully
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3585c866-8f97-4050-9eda-7bc3e0cd0200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83863) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}}
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Flow 'volume_create_manager' (3f19f458-516c-4161-9f34-9d0d956af02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83863) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}}
Apr 29 09:19:57 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-205e57c4-b448-4bae-80f9-0d959ad0e16e tempest-CinderUnicodeTest-1426668885 None] Created volume successfully.
Apr 29 09:19:57 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" returned: 0 in 0.751s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:57 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:57 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a
Apr 29 09:19:57 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Creating offline snapshot 31fb207b-e60c-423a-a345-ca9de517c90e of volume eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[559a5289-cd27-4d7c-a58d-0ab559e22fc7]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:58 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a" released by "delete_volume" :: held 1.431s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Created reservations ['6f53502f-f6bb-4907-b4a1-f29d13431f16', '8a7c1c6d-8e27-4f8c-94ef-2a0e1210a426', 'e85b4f9e-a351-4624-a57b-f036cbdb4c30', 'c988585b-9546-4540-b376-b38de2f3c870'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:19:58 devstack sudo[93426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614
Apr 29 09:19:58 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:58 devstack sudo[93428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:58 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:58 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614" returned: 0 in 0.741s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e 1G {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:58 devstack sudo[93434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e 1G
Apr 29 09:19:58 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-b59b193b-234d-46e8-8c5b-4ecba593c940-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Lock "cinder-b59b193b-234d-46e8-8c5b-4ecba593c940-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:58 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.653s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:58 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:58 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Deleted volume successfully.
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-92a60dd9-61ad-4da9-97d6-9144dedb6c53 tempest-VolumeDependencyTests-333341022 None] Lock "cinder-dc3d4fd7-e4e6-42e9-a8a4-01ef109ef30a-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-b59b193b-234d-46e8-8c5b-4ecba593c940" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-b59b193b-234d-46e8-8c5b-4ecba593c940" acquired by "delete_volume" :: waited 0.014s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[82422a20-d775-4c0a-b96c-95ed372a21ee]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_service.periodic_task [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83863) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:59 devstack sudo[93436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940
Apr 29 09:19:59 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:59 devstack sudo[93437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:19:59 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:59 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e 1G" returned: 0 in 0.759s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec200cc-3434-4f22-a8dc-1800b4548614 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:59 devstack sudo[93445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec200cc-3434-4f22-a8dc-1800b4548614 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e
Apr 29 09:19:59 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:19:59 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.630s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-1f52ea6d-2e17-4cd6-88f9-ef9fba8198ca None None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:19:59 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940" returned: 0 in 0.743s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:19:59 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:19:59 devstack sudo[93451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940
Apr 29 09:19:59 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:00 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eec200cc-3434-4f22-a8dc-1800b4548614 -F qcow2 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e" returned: 0 in 0.640s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:00 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e is being set with open permissions: ugo+rw
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:00 devstack sudo[93457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e
Apr 29 09:20:00 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:00 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-b59b193b-234d-46e8-8c5b-4ecba593c940" returned: 0 in 0.580s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-b59b193b-234d-46e8-8c5b-4ecba593c940" released by "delete_volume" :: held 1.367s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Created reservations ['3011c007-fe54-4894-8790-ba3c4afe308c', '76ea25c7-ed25-4af5-80df-cbcd4d5dea67', 'ac88adac-e81c-40bf-8046-224f2f44b289', '6f6bd763-9734-4ae6-ae49-cb6f7e6a736b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:00 devstack sudo[93459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:20:00 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:00 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:00 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:00 devstack sudo[93462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.info
Apr 29 09:20:00 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:01 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.607s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:20:01 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Deleted volume successfully.
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-3dd6e680-2168-40e2-9b61-011510122cba tempest-VolumeDependencyTests-333341022 None] Lock "cinder-b59b193b-234d-46e8-8c5b-4ecba593c940-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-18e68fe0-e009-4f54-9d3f-06b932992506-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Lock "cinder-18e68fe0-e009-4f54-9d3f-06b932992506-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Acquiring lock "cinder-quobyte-18e68fe0-e009-4f54-9d3f-06b932992506" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-18e68fe0-e009-4f54-9d3f-06b932992506" acquired by "delete_volume" :: waited 0.016s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aacf22-f526-4c79-bd02-7e5c79265845]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:01 devstack sudo[93465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506
Apr 29 09:20:01 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:01 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.info" returned: 0 in 0.609s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:01 devstack cinder-volume[83863]: WARNING cinder.volume.drivers.remotefs [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.info is being set with open permissions: ugo+rw
Apr 29 09:20:01 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.info {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:01 devstack sudo[93468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.info
Apr 29 09:20:01 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:02 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506" returned: 0 in 0.700s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:02 devstack sudo[93474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506
Apr 29 09:20:02 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:02 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.info" returned: 0 in 0.608s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.052s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:20:02 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-6be84a64-7fa9-4391-b599-a52077081b95 tempest-CinderUnicodeTest-1426668885 None] Create snapshot completed successfully
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "cinder-31fb207b-e60c-423a-a345-ca9de517c90e-delete_snapshot" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-31fb207b-e60c-423a-a345-ca9de517c90e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "cinder-quobyte-eec200cc-3434-4f22-a8dc-1800b4548614" by "delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-eec200cc-3434-4f22-a8dc-1800b4548614" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "cinder-quobyte-31fb207b-e60c-423a-a345-ca9de517c90e" by "_delete_snapshot" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-31fb207b-e60c-423a-a345-ca9de517c90e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Deleting offline snapshot 31fb207b-e60c-423a-a345-ca9de517c90e of volume eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] snapshot_file for this snap is: volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e {{(pid=83863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6201b5-3fa4-4b02-9e0f-bb353be91bc4]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:02 devstack sudo[93476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e
Apr 29 09:20:02 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:02 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-18e68fe0-e009-4f54-9d3f-06b932992506" returned: 0 in 0.614s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Lock "cinder-quobyte-18e68fe0-e009-4f54-9d3f-06b932992506" released by "delete_volume" :: held 1.356s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Created reservations ['46d2c7a6-8a49-465b-8563-eed7f9619904', '97a44938-211a-45e3-a080-57d6673390b5', '2c2aba63-eafa-41ca-bd97-f0334ec31040', '0da05a90-fd20-4e06-bfa8-455b3f4c0fc9'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:20:02 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:02 devstack sudo[93479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:20:02 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:03 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e" returned: 0 in 0.725s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.remotefs [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eec200cc-3434-4f22-a8dc-1800b4548614(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ec814-ab4c-4886-bce2-63a8f3672192]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:03 devstack sudo[93484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614
Apr 29 09:20:03 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:03 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.584s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:20:03 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Deleted volume successfully.
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-4991405a-5088-4cc2-8e7e-a8b9e1c095cb tempest-VolumeDependencyTests-333341022 None] Lock "cinder-18e68fe0-e009-4f54-9d3f-06b932992506-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:03 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614" returned: 0 in 0.742s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:03 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:03 devstack sudo[93490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e
Apr 29 09:20:03 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:04 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e" returned: 0 in 0.714s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:04 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:04 devstack sudo[93496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e
Apr 29 09:20:04 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:05 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614.31fb207b-e60c-423a-a345-ca9de517c90e" returned: 0 in 0.616s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-31fb207b-e60c-423a-a345-ca9de517c90e" released by "_delete_snapshot" :: held 2.900s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-eec200cc-3434-4f22-a8dc-1800b4548614" released by "delete_snapshot" :: held 2.921s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Created reservations ['5c1a2393-7762-4fb6-b1da-d8771806a549', '0488d674-24c7-4fdb-bc74-1f8b135fef71', '45c06c92-6075-4600-a828-4cd061a8c379', '92d28bc9-6fae-434e-88b8-6bff208448a7'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:20:05 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Delete snapshot completed successfully.
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-bb8f92ea-ed21-4743-8e88-752e51b88e12 tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-31fb207b-e60c-423a-a345-ca9de517c90e-delete_snapshot" released by "delete_snapshot" :: held 3.047s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "cinder-eec200cc-3434-4f22-a8dc-1800b4548614-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-eec200cc-3434-4f22-a8dc-1800b4548614-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "cinder-quobyte-eec200cc-3434-4f22-a8dc-1800b4548614" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-eec200cc-3434-4f22-a8dc-1800b4548614" acquired by "delete_volume" :: waited 0.013s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9041568-43e9-435a-8d77-d73006baf8c1]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:20:05 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:05 devstack sudo[93499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614
Apr 29 09:20:05 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:06 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614" returned: 0 in 0.693s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:06 devstack sudo[93504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614
Apr 29 09:20:06 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:06 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:06 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-eec200cc-3434-4f22-a8dc-1800b4548614" returned: 0 in 0.593s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:06 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-eec200cc-3434-4f22-a8dc-1800b4548614" released by "delete_volume" :: held 1.342s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:06 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Created reservations ['459c168f-c710-4a32-bfaf-2de4f2891fed', 'dd86ffab-da2f-443a-aae4-4fa313e6eb13', '5100448e-2f0f-4108-834b-d9f6ce58f611', '551d13e9-b956-4ce7-ae51-0faa49f9214b'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:07 devstack sudo[93509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:20:07 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:07 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:20:07 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Deleted volume successfully.
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-e654b3fb-75a7-4d48-8247-e5699032ddbb tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-eec200cc-3434-4f22-a8dc-1800b4548614-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "cinder-831c431e-2e21-4fea-995f-df868fc22e87-delete_volume" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-831c431e-2e21-4fea-995f-df868fc22e87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "cinder-quobyte-831c431e-2e21-4fea-995f-df868fc22e87" by "delete_volume" {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-831c431e-2e21-4fea-995f-df868fc22e87" acquired by "delete_volume" :: waited 0.015s {{(pid=83863) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03ca50-007c-41e3-94eb-f0444777f0bd]: (4, 'qcow2') {{(pid=84585) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}}
Apr 29 09:20:07 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:07 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87
Apr 29 09:20:07 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:08 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87" returned: 0 in 0.675s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:08 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:08 devstack sudo[93517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87
Apr 29 09:20:08 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:09 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621/volume-831c431e-2e21-4fea-995f-df868fc22e87" returned: 0 in 0.568s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-quobyte-831c431e-2e21-4fea-995f-df868fc22e87" released by "delete_volume" :: held 1.281s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG cinder.quota [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Created reservations ['8d195164-5924-4d6b-a372-5deb34566d21', 'ef43c6c2-23c1-4b40-9a7f-fbbd2d66fda6', '5467fb5e-fbf0-47b6-8465-a43b54a564ac', '1e307380-086e-4899-bb73-9f37ff7629ac'] {{(pid=83863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d': None} {{(pid=83863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG cinder.volume.drivers.quobyte [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5b327521-a0f3-4a78-97b6-b7a7c309cd9d'] {{(pid=83863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.lockutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83863) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621 {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Apr 29 09:20:09 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621
Apr 29 09:20:09 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 29 09:20:09 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG oslo_concurrency.processutils [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/764777abdd40353253ef909ec2b48621" returned: 0 in 0.580s {{(pid=83863) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG cinder.manager [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Notifying Schedulers of capabilities ... {{(pid=83863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 29 09:20:09 devstack cinder-volume[83863]: INFO cinder.volume.manager [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Deleted volume successfully.
Apr 29 09:20:09 devstack cinder-volume[83863]: DEBUG cinder.coordination [None req-021de9e5-778d-4fb6-8604-d0b49de2954a tempest-CinderUnicodeTest-1426668885 None] Lock "cinder-831c431e-2e21-4fea-995f-df868fc22e87-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=83863) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 29 09:20:19 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=71,cinder:INSERT=31,cinder:UPDATE=118,cinder:DELETE=5 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 29 09:20:19 devstack cinder-volume[83863]: DEBUG dbcounter [-] [83863] Writing DB stats cinder:SELECT=79,cinder:INSERT=27,cinder:UPDATE=104,cinder:DELETE=11 {{(pid=83863) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}